Sep 17 14:59:21 devstack cinder-volume[75451]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75451) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 14:59:21 devstack cinder-volume[75451]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75451) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 14:59:21 devstack cinder-volume[75451]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75451) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 14:59:23 devstack cinder-volume[75451]: INFO dbcounter [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Registered counter for database cinder
Sep 17 14:59:23 devstack cinder-volume[75451]: DEBUG oslo_db.sqlalchemy.engines [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75451) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 14:59:23 devstack cinder-volume[75451]: DEBUG dbcounter [-] [75451] Writer thread running {{(pid=75451) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 14:59:23 devstack cinder-volume[75451]: INFO cinder.rpc [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 17 14:59:23 devstack cinder-volume[75451]: INFO cinder.rpc [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 17 14:59:23 devstack cinder-volume[75451]: DEBUG oslo_db.sqlalchemy.engines [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75451) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 14:59:23 devstack cinder-volume[75451]: INFO cinder.volume.manager [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Determined volume DB was empty at startup.
Sep 17 14:59:23 devstack cinder-volume[75451]: DEBUG cinder.volume.manager [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75451) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 17 14:59:23 devstack cinder-volume[75451]: INFO cinder.volume.manager [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 17 14:59:23 devstack cinder-volume[75451]: WARNING stevedore.named [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 17 14:59:23 devstack cinder-volume[75451]: WARNING castellan.key_manager [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 14:59:23 devstack cinder-volume[75451]: WARNING cinder.keymgr.conf_key_mgr [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 14:59:23 devstack cinder-volume[75451]: DEBUG cinder.volume.drivers.lvm [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75451) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 17 14:59:23 devstack cinder-volume[75451]: DEBUG oslo_concurrency.processutils [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75451) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_concurrency.processutils [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] CMD "cinder-rtstool verify" returned: 0 in 1.379s {{(pid=75451) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_db.sqlalchemy.engines [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75451) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 14:59:25 devstack cinder-volume[75451]: INFO cinder.rpc [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 17 14:59:25 devstack cinder-volume[75451]: INFO cinder.rpc [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 17 14:59:25 devstack cinder-volume[75451]: WARNING stevedore.named [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 17 14:59:25 devstack cinder-volume[75451]: WARNING castellan.key_manager [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 14:59:25 devstack cinder-volume[75451]: INFO cinder.volume.manager [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_db.sqlalchemy.engines [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75451) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 14:59:25 devstack cinder-volume[75451]: INFO oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Starting 1 workers
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Started child 75642 {{(pid=75451) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Full set of CONF: {{(pid=75451) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] ******************************************************************************** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Configuration options gathered from: {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] ================================================================================ {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] allow_availability_zone_fallback = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] allow_compression_on_image_upload = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] allowed_direct_url_schemes     = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] api_rate_limit                 = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] auth_strategy                  = keystone {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] az_cache_duration              = 3600 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_availability_zone      = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_host                   = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_name                   = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_stats_polling_interval = 60 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backup_api_class               = cinder.backup.api.API {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backup_name_template           = backup-%s {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75642]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backup_use_same_host           = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backup_use_temp_snapshot       = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] chap_password                  = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] chap_username                  =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cinder_internal_tenant_project_id = c4ffca5ab731406e825c38a85472d426 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cinder_internal_tenant_user_id = 352ed0678cca4590b747267afc45a05c {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cloned_volume_same_az          = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cluster                        = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] compression_format             = gzip {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] compute_api_class              = cinder.compute.nova.API {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] config_dir                     = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] config_source                  = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] control_exchange               = openstack {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] debug                          = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] default_availability_zone      = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] default_group_type             = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] default_volume_type            = lvmdriver-1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] driver_client_cert             = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] driver_client_cert_key         = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] driver_data_namespace          = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] driver_ssl_cert_path           = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] driver_ssl_cert_verify         = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] driver_use_ssl                 = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] enable_force_upload            = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] enable_new_services            = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] enable_unsupported_driver      = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] enforce_multipath_for_image_xfer = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] filter_function                = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_api_insecure            = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_api_servers             = ['http://192.168.122.203/image'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_api_ssl_compression     = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_ca_certificates_file    = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_catalog_info            = image:glance:publicURL {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_certfile                = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_keyfile                 = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_num_retries             = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance_request_timeout         = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] goodness_function              = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] graceful_shutdown_timeout      = 5 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] group_api_class                = cinder.group.api.API {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] host                           = devstack {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_compress_on_upload       = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_conversion_address_space_limit = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_conversion_cpu_limit     = 60 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_conversion_disable       = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_upload_use_cinder_backend = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_upload_use_internal_tenant = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_volume_cache_enabled     = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_volume_cache_max_count   = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] image_volume_cache_max_size_gb = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] init_host_max_objects_retrieval = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] instance_format                = [instance: %(uuid)s]  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] iscsi_iotype                   = fileio {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] iscsi_target_flags             =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] iscsi_write_cache              = on {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] iser_helper                    = tgtadm {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] iser_ip_address                = 192.168.122.203 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] iser_port                      = 3260 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] log_color                      = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] log_config_append              = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] log_dir                        = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] log_file                       = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] log_options                    = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] log_rotate_interval            = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] log_rotate_interval_type       = days {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] log_rotation_type              = none {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] max_age                        = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] max_logfile_count              = 30 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] max_logfile_size_mb            = 200 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] max_over_subscription_ratio    = 20.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] message_reap_interval          = 86400 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] message_ttl                    = 2592000 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] migration_create_volume_timeout_secs = 300 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] monkey_patch                   = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] monkey_patch_modules           = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] my_ip                          = 192.168.122.203 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] no_snapshot_gb_quota           = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] num_iser_scan_tries            = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] num_shell_tries                = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] num_volume_device_scan_tries   = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] nvmeof_conn_info_version       = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] nvmet_ns_id                    = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] nvmet_port_id                  = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] osapi_max_limit                = 1000 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] osapi_volume_ext_list          = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] osapi_volume_listen_port       = 8776 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] osapi_volume_use_ssl           = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] osapi_volume_workers           = 2 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] per_volume_size_limit          = -1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] periodic_fuzzy_delay           = 60 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] periodic_interval              = 60 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] public_endpoint                = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] publish_errors                 = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] quota_backup_gigabytes         = 1000 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] quota_backups                  = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] quota_gigabytes                = 1000 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] quota_groups                   = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] quota_snapshots                = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] quota_volumes                  = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] rate_limit_burst               = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] rate_limit_except_level        = CRITICAL {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] rate_limit_interval            = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] reinit_driver_count            = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] replication_device             = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] report_discard_supported       = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] report_interval                = 120 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] reservation_clean_interval     = 86400 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] reservation_expire             = 86400 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] reserved_image_namespaces      = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] reserved_percentage            = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] rpc_response_timeout           = 120 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] run_external_periodic_tasks    = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] scst_target_driver             = iscsi {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] scst_target_iqn_name           = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_down_time              = 720 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] shell_completion               = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] snapshot_name_template         = snapshot-%s {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] snapshot_same_host             = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] split_loggers                  = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] state_path                     = /opt/stack/data/cinder {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] storage_availability_zone      = nova {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] storage_protocol               = iSCSI {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] syslog_log_facility            = LOG_USER {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] target_helper                  = lioadm {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] target_ip_address              = 192.168.122.203 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] target_port                    = 3260 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] target_protocol                = iscsi {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] target_secondary_ip_addresses  = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] trace_flags                    = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] transport_url                  = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] until_refresh                  = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:25 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] use_chap_auth                  = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] use_default_quota_class        = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] use_journal                    = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] use_json                       = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] use_multipath_for_image_xfer   = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] use_stderr                     = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] use_syslog                     = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] verify_glance_signatures       = enabled {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_api_class               = cinder.volume.api.API {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_backend_name            = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_clear                   = zero {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_clear_ionice            = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_clear_size              = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_copy_bps_limit          = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_dd_blocksize            = 1M {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_name_template           = volume-%s {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_service_inithost_offload = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volume_usage_audit_period      = month {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] watch_log_file                 = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] zoning_mode                    = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_concurrency.disable_process_locking = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.admin_password = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.admin_token = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.admin_user  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.auth_port   = 35357 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.auth_protocol = https {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.auth_section = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.auth_type   = password {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.auth_uri    = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.auth_version = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.cache       = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.certfile    = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.delay_auth_decision = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.http_connect_timeout = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.identity_uri = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.include_service_catalog = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.insecure    = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.interface   = public {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.keyfile     = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_password =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcache_username =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75642]: INFO cinder.volume.manager [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.region_name = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.service_token_roles_required = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.service_type = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.token_cache_time = 300 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.backend                  = dogpile.cache.null {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.backend_argument         = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.backend_expiration_time  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.config_prefix            = cache.oslo {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.dead_timeout             = 60.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.debug_cache_backend      = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.enable_retry_client      = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.enable_socket_keepalive  = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.enabled                  = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.enforce_fips_mode        = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.expiration_time          = 600 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.hashclient_retry_attempts = 2 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_dead_retry      = 300 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_password        = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_pool_maxsize    = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_sasl_enabled    = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.memcache_username        = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.proxies                  = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.redis_db                 = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.redis_password           = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.redis_sentinel_service_name = mymaster {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.redis_server             = localhost:6379 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.redis_socket_timeout     = 1.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.redis_username           = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.retry_attempts           = 2 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.retry_delay              = 0.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.socket_keepalive_count   = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.socket_keepalive_idle    = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.socket_keepalive_interval = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.tls_allowed_ciphers      = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.tls_cafile               = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.tls_certfile             = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.tls_enabled              = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cache.tls_keyfile              = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] coordination.backend_url       = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.asyncio_connection    = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.asyncio_slave_connection = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.backend               = sqlalchemy {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.connection            = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.connection_debug      = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.connection_parameters =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.connection_recycle_time = 3600 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.connection_trace      = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.db_inc_retry_interval = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.db_max_retries        = 20 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.db_max_retry_interval = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.db_retry_interval     = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.max_overflow          = 50 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.max_pool_size         = 5 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.max_retries           = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.mysql_wsrep_sync_wait = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.pool_timeout          = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.retry_interval        = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.slave_connection      = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.sqlite_synchronous    = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] database.use_db_reconnect      = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.connection_string     = messaging:// {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.enabled               = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.es_doc_type           = notification {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.es_scroll_size        = 10000 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.es_scroll_time        = 2m {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.filter_error_trace    = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.hmac_keys             = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.sentinel_service_name = mymaster {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.socket_timeout        = 0.1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.trace_requests        = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler.trace_sqlalchemy      = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler_jaeger.process_tags   = {} {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler_jaeger.service_name_prefix = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] profiler_otlp.service_name_prefix = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.enforce_new_defaults = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: WARNING oslo_config.cfg [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.enforce_scope      = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.policy_default_rule = default {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.policy_file        = policy.yaml {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] privsep_osbrick.group          = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] privsep_osbrick.helper_command = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] privsep_osbrick.user           = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cinder_sys_admin.group         = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cinder_sys_admin.helper_command = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] cinder_sys_admin.user          = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.auth_section      = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.auth_type         = password {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.certfile          = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.collect_timing    = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.insecure          = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.keyfile           = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.send_service_user_token = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.split_loggers     = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] service_user.timeout           = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance.auth_section            = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance.auth_type               = password {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance.certfile                = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance.collect_timing          = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance.insecure                = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance.keyfile                 = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance.split_loggers           = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] glance.timeout                 = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.backend_availability_zone = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.chap_password = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.chap_username =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.driver_client_cert = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.driver_client_cert_key = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.driver_data_namespace = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.driver_use_ssl = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.enable_unsupported_driver = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.extra_capabilities = {} {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.filter_function = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.goodness_function = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.iscsi_target_flags =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.iscsi_write_cache = on {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.iser_helper   = tgtadm {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.iser_ip_address = 192.168.122.203 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.iser_port     = 3260 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.lvm_share_target = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.lvm_type      = auto {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.num_shell_tries = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.nvmet_port_id = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.replication_device = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.report_discard_supported = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.reserved_percentage = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.scst_target_driver = iscsi {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.scst_target_iqn_name = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.storage_protocol = iSCSI {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.target_helper = tgtadm {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.target_ip_address = 192.168.122.203 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.target_port   = 3260 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.target_protocol = iscsi {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.trace_flags   = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.unique_fqdn_network = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.use_chap_auth = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volume_backend_name = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volume_clear  = zero {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volume_clear_ionice = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volume_clear_size = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.216s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_reports.file_event_handler = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_reports.log_dir           = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.backend_availability_zone = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.backend_host       = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.chap_password      = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.chap_username      = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.driver_client_cert = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.driver_data_namespace = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.extra_capabilities = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.filter_function    = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.goodness_function  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.iser_helper        = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.iser_ip_address    = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.iser_port          = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.iser_target_prefix = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.lvm_share_target   = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.lvm_type           = auto {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.num_shell_tries    = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.replication_device = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.report_discard_supported = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.reserved_percentage = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.scst_target_driver = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.storage_protocol   = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.target_helper      = lioadm {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.target_ip_address  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.target_port        = 3260 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.trace_flags        = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.use_chap_auth      = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volume_clear       = zero {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volume_clear_size  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] lvmdriver-1.volumes_dir        = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.ssl      = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_notifications.driver = [] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_notifications.retry = -1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] key_manager.fixed_key          = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.barbican_api_version  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.barbican_endpoint     = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.barbican_endpoint_type = public {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.barbican_region_name  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.cafile                = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.certfile              = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.collect_timing        = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.insecure              = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.keyfile               = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.number_of_retries     = 60 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.retry_delay           = 1 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.send_service_user_token = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.split_loggers         = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.timeout               = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.verify_ssl            = True {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican.verify_ssl_path       = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican_service_user.auth_section = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican_service_user.auth_type = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican_service_user.cafile   = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican_service_user.certfile = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican_service_user.collect_timing = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican_service_user.insecure = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican_service_user.keyfile  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican_service_user.split_loggers = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] barbican_service_user.timeout  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.approle_role_id          = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.approle_secret_id        = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.kv_mountpoint            = secret {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.kv_path                  = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.kv_version               = 2 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.namespace                = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.root_token_id            = **** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.ssl_ca_crt_file          = None {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.timeout                  = 60.0 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.use_ssl                  = False {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 14:59:26 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] ******************************************************************************** {{(pid=75451) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 17 14:59:26 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.123s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:26 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:26 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.090s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:26 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:26 devstack sudo[75694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 17 14:59:26 devstack sudo[75694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:28 devstack sudo[75694]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:28 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.020s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:28 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:28 devstack sudo[75805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 14:59:28 devstack sudo[75805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:30 devstack sudo[75805]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:30 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.912s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:30 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 14:59:30 devstack cinder-volume[75642]: INFO cinder.brick.local_dev.lvm [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 17 14:59:30 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:30 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.084s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:30 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:30 devstack sudo[75902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 14:59:30 devstack sudo[75902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:32 devstack sudo[75902]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:32 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.913s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:32 devstack cinder-volume[75642]: DEBUG cinder.brick.local_dev.lvm [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75642) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 17 14:59:32 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:32 devstack sudo[75997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 14:59:32 devstack sudo[75997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:35 devstack cinder-volume[75451]: DEBUG dbcounter [-] [75451] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75451) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 14:59:36 devstack sudo[75997]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:36 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.534s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:36 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:36 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.128s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:36 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:36 devstack sudo[76181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 14:59:36 devstack sudo[76181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:38 devstack sudo[76181]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:38 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.033s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:38 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:38 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.109s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:38 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:38 devstack sudo[76219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 17 14:59:38 devstack sudo[76219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:41 devstack sudo[76219]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:41 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.561s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:41 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:41 devstack sudo[76263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 14:59:41 devstack sudo[76263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:44 devstack sudo[76263]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:44 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.878s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:44 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:44 devstack sudo[76312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 14:59:44 devstack sudo[76312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:46 devstack sudo[76312]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:46 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.709s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:46 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:46 devstack sudo[76317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 14:59:46 devstack sudo[76317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:49 devstack sudo[76317]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:49 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.799s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:49 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:49 devstack sudo[76323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 14:59:49 devstack sudo[76323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:51 devstack sudo[76323]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:51 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.068s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:51 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:51 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.149s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:51 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:52 devstack sudo[76361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 14:59:52 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:53 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:53 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.891s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:53 devstack cinder-volume[75642]: INFO cinder.volume.drivers.lvm [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 17 14:59:53 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:53 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.081s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:53 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:54 devstack sudo[76452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 14:59:54 devstack sudo[76452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:55 devstack sudo[76452]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:55 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.841s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:55 devstack cinder-volume[75642]: DEBUG cinder.volume.drivers.lvm [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Updating volume stats {{(pid=75642) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 14:59:55 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:55 devstack sudo[76587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 14:59:55 devstack sudo[76587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:57 devstack sudo[76587]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:57 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.957s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:57 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:57 devstack sudo[76597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 14:59:57 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 14:59:59 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root
Sep 17 14:59:59 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.996s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 14:59:59 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 14:59:59 devstack sudo[76601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 14:59:59 devstack sudo[76601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:01 devstack sudo[76601]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:01 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.777s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:01 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:01 devstack sudo[76607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:00:01 devstack sudo[76607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:03 devstack sudo[76607]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:03 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.796s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:03 devstack cinder-volume[75642]: INFO cinder.volume.driver [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Driver hasn't implemented _init_vendor_properties()
Sep 17 15:00:03 devstack cinder-volume[75642]: DEBUG cinder.volume.driver [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75642) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 17 15:00:03 devstack cinder-volume[75642]: DEBUG oslo_db.sqlalchemy.engines [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75642) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 15:00:03 devstack cinder-volume[75642]: DEBUG dbcounter [-] [75642] Writer thread running {{(pid=75642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 15:00:03 devstack cinder-volume[75642]: DEBUG cinder.db.sqlalchemy.api [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Building query based on filter {{(pid=75642) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 17 15:00:03 devstack cinder-volume[75642]: DEBUG cinder.image.image_utils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75642) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 17 15:00:03 devstack cinder-volume[75642]: INFO cinder.keymgr.migration [None req-e9cb741f-3434-408a-a36d-571b08c44da8 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 17 15:00:03 devstack cinder-volume[75642]: DEBUG cinder.volume.drivers.lvm [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Updating volume stats {{(pid=75642) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 15:00:03 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:03 devstack sudo[76621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 15:00:03 devstack sudo[76621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:05 devstack sudo[76621]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:05 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.940s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:05 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:05 devstack sudo[76730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:00:05 devstack sudo[76730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:07 devstack sudo[76730]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:07 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.897s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:07 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:07 devstack sudo[76758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 15:00:07 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:09 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:09 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.930s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:09 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:09 devstack sudo[76762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:00:09 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:11 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:11 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.768s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:11 devstack cinder-volume[75642]: DEBUG cinder.manager [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Notifying Schedulers of capabilities ... {{(pid=75642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:00:11 devstack cinder-volume[75642]: INFO cinder.volume.manager [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Driver initialization completed successfully.
Sep 17 15:00:11 devstack cinder-volume[75642]: INFO cinder.manager [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Initiating service 2 cleanup
Sep 17 15:00:11 devstack cinder-volume[75642]: INFO cinder.manager [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Service 2 cleanup completed.
Sep 17 15:00:11 devstack cinder-volume[75642]: DEBUG cinder.service [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Creating RPC server for service cinder-volume {{(pid=75642) start /opt/stack/cinder/cinder/service.py:239}}
Sep 17 15:00:11 devstack cinder-volume[75642]: DEBUG cinder.service [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75642) start /opt/stack/cinder/cinder/service.py:245}}
Sep 17 15:00:11 devstack cinder-volume[75642]: INFO cinder.volume.manager [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 17 15:00:11 devstack cinder-volume[75642]: DEBUG cinder.volume.drivers.lvm [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Updating volume stats {{(pid=75642) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 15:00:11 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:11 devstack sudo[76765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 15:00:11 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:13 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:13 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.992s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:13 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:13 devstack sudo[76773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:00:13 devstack sudo[76773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:15 devstack sudo[76773]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:16 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:16 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:16 devstack sudo[76781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 15:00:16 devstack sudo[76781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:18 devstack sudo[76781]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:18 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.381s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:18 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:18 devstack sudo[76784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:00:18 devstack sudo[76784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:20 devstack sudo[76784]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:20 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.034s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:20 devstack cinder-volume[75642]: INFO cinder.volume.manager [None req-9463a50a-c6ac-43b4-b112-60a01f192517 None None] Driver post RPC initialization completed successfully.
Sep 17 15:00:21 devstack cinder-volume[75642]: DEBUG dbcounter [-] [75642] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:00:23 devstack cinder-volume[75642]: DEBUG oslo_service.periodic_task [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:00:23 devstack cinder-volume[75642]: DEBUG cinder.volume.drivers.lvm [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Updating volume stats {{(pid=75642) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 15:00:23 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:23 devstack sudo[76794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 15:00:23 devstack sudo[76794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:25 devstack sudo[76794]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:25 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.732s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:25 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:25 devstack sudo[76809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:00:25 devstack sudo[76809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:27 devstack sudo[76809]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:27 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.931s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:27 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:27 devstack sudo[76832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 15:00:27 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:29 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:29 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.967s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:29 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:00:29 devstack sudo[76861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:00:29 devstack sudo[76861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:00:30 devstack cinder-volume[75642]: DEBUG dbcounter [-] [75642] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:00:31 devstack sudo[76861]: pam_unix(sudo:session): session closed for user root
Sep 17 15:00:32 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.544s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:00:32 devstack cinder-volume[75642]: DEBUG cinder.manager [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Notifying Schedulers of capabilities ... {{(pid=75642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:02:23 devstack cinder-volume[75642]: DEBUG oslo_service.periodic_task [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:02:23 devstack cinder-volume[75642]: DEBUG cinder.volume.drivers.lvm [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Updating volume stats {{(pid=75642) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 15:02:23 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:02:23 devstack sudo[78885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 15:02:23 devstack sudo[78885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:02:25 devstack sudo[78885]: pam_unix(sudo:session): session closed for user root
Sep 17 15:02:25 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.908s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:02:25 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:02:25 devstack sudo[78891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:02:25 devstack sudo[78891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:02:27 devstack sudo[78891]: pam_unix(sudo:session): session closed for user root
Sep 17 15:02:27 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.075s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:02:27 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:02:28 devstack sudo[79032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 15:02:28 devstack sudo[79032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:02:30 devstack sudo[79032]: pam_unix(sudo:session): session closed for user root
Sep 17 15:02:30 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.234s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:02:30 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:02:30 devstack sudo[79154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:02:30 devstack sudo[79154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:02:30 devstack cinder-volume[75642]: DEBUG dbcounter [-] [75642] Writing DB stats cinder:SELECT=1 {{(pid=75642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:02:30 devstack cinder-volume[75642]: DEBUG dbcounter [-] [75642] Writing DB stats cinder:UPDATE=1 {{(pid=75642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:02:32 devstack sudo[79154]: pam_unix(sudo:session): session closed for user root
Sep 17 15:02:32 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.012s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:02:32 devstack cinder-volume[75642]: DEBUG cinder.manager [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Notifying Schedulers of capabilities ... {{(pid=75642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:03:23 devstack cinder-volume[75642]: DEBUG oslo_service.periodic_task [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:03:23 devstack cinder-volume[75642]: DEBUG cinder.volume.drivers.lvm [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Updating volume stats {{(pid=75642) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 15:03:23 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:03:23 devstack sudo[81669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 15:03:23 devstack sudo[81669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:03:25 devstack sudo[81669]: pam_unix(sudo:session): session closed for user root
Sep 17 15:03:25 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.747s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:03:25 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:03:25 devstack sudo[81673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:03:25 devstack sudo[81673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:03:27 devstack sudo[81673]: pam_unix(sudo:session): session closed for user root
Sep 17 15:03:27 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.713s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:03:27 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:03:27 devstack sudo[81676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 15:03:27 devstack sudo[81676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:03:29 devstack sudo[81676]: pam_unix(sudo:session): session closed for user root
Sep 17 15:03:29 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.908s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:03:29 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:03:29 devstack sudo[81709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:03:29 devstack sudo[81709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:03:31 devstack sudo[81709]: pam_unix(sudo:session): session closed for user root
Sep 17 15:03:31 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.933s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:03:31 devstack cinder-volume[75642]: DEBUG cinder.manager [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Notifying Schedulers of capabilities ... {{(pid=75642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:04:23 devstack cinder-volume[75642]: DEBUG oslo_service.periodic_task [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:04:23 devstack cinder-volume[75642]: DEBUG cinder.volume.drivers.lvm [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Updating volume stats {{(pid=75642) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 15:04:23 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:04:23 devstack sudo[81972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 15:04:23 devstack sudo[81972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:04:25 devstack sudo[81972]: pam_unix(sudo:session): session closed for user root
Sep 17 15:04:25 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.749s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:04:25 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:04:25 devstack sudo[81975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:04:25 devstack sudo[81975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:04:27 devstack sudo[81975]: pam_unix(sudo:session): session closed for user root
Sep 17 15:04:27 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.829s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:04:27 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:04:27 devstack sudo[81978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 15:04:27 devstack sudo[81978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:04:29 devstack sudo[81978]: pam_unix(sudo:session): session closed for user root
Sep 17 15:04:29 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.719s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:04:29 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:04:29 devstack sudo[81981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:04:29 devstack sudo[81981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:04:30 devstack cinder-volume[75642]: DEBUG dbcounter [-] [75642] Writing DB stats cinder:SELECT=1 {{(pid=75642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:04:30 devstack cinder-volume[75642]: DEBUG dbcounter [-] [75642] Writing DB stats cinder:UPDATE=1 {{(pid=75642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:04:31 devstack sudo[81981]: pam_unix(sudo:session): session closed for user root
Sep 17 15:04:31 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.941s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:04:31 devstack cinder-volume[75642]: DEBUG cinder.manager [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Notifying Schedulers of capabilities ... {{(pid=75642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:05:23 devstack cinder-volume[75642]: DEBUG oslo_service.periodic_task [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:05:23 devstack cinder-volume[75642]: DEBUG cinder.volume.drivers.lvm [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Updating volume stats {{(pid=75642) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 15:05:23 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:05:23 devstack sudo[82678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 15:05:23 devstack sudo[82678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:05:26 devstack sudo[82678]: pam_unix(sudo:session): session closed for user root
Sep 17 15:05:26 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.403s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:05:26 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:05:26 devstack sudo[82704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:05:26 devstack sudo[82704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:05:28 devstack sudo[82704]: pam_unix(sudo:session): session closed for user root
Sep 17 15:05:28 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.298s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:05:28 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:05:28 devstack sudo[82746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 15:05:28 devstack sudo[82746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:05:30 devstack sudo[82746]: pam_unix(sudo:session): session closed for user root
Sep 17 15:05:30 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.143s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:05:30 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:05:30 devstack sudo[82773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 15:05:30 devstack sudo[82773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:05:34 devstack sudo[82773]: pam_unix(sudo:session): session closed for user root
Sep 17 15:05:34 devstack cinder-volume[75642]: DEBUG oslo_concurrency.processutils [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.383s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:05:34 devstack cinder-volume[75642]: DEBUG cinder.manager [None req-2002a90a-0287-42b3-9d4e-42ac46f51516 None None] Notifying Schedulers of capabilities ... {{(pid=75642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:05:39 devstack cinder-volume[75451]: INFO oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Caught SIGTERM, stopping children
Sep 17 15:05:39 devstack cinder-volume[75451]: DEBUG oslo_concurrency.lockutils [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Acquiring lock "singleton_lock" {{(pid=75451) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 15:05:39 devstack cinder-volume[75451]: DEBUG oslo_concurrency.lockutils [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Acquired lock "singleton_lock" {{(pid=75451) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 15:05:39 devstack cinder-volume[75451]: DEBUG oslo_concurrency.lockutils [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Releasing lock "singleton_lock" {{(pid=75451) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 15:05:39 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Stop services. {{(pid=75451) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 17 15:05:39 devstack cinder-volume[75451]: DEBUG oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Killing children. {{(pid=75451) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 17 15:05:39 devstack cinder-volume[75451]: INFO oslo_service.backend._eventlet.service [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Waiting on 1 children to exit
Sep 17 15:05:44 devstack cinder-volume[75642]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 17 15:05:46 devstack cinder-volume[75642]: DEBUG oslo_concurrency.lockutils [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Acquiring lock "singleton_lock" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 15:05:46 devstack cinder-volume[75642]: DEBUG oslo_concurrency.lockutils [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Acquired lock "singleton_lock" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 15:05:46 devstack cinder-volume[75642]: DEBUG oslo_concurrency.lockutils [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Releasing lock "singleton_lock" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 15:05:46 devstack cinder-volume[75642]: WARNING amqp [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 17 15:05:46 devstack cinder-volume[75642]: WARNING amqp [None req-ff944943-5dfc-4526-8bbb-79cbd8ee1b0c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 17 15:05:59 devstack cinder-volume[83005]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 15:05:59 devstack cinder-volume[83005]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 15:05:59 devstack cinder-volume[83005]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 15:06:01 devstack cinder-volume[83005]: INFO dbcounter [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Registered counter for database cinder
Sep 17 15:06:01 devstack cinder-volume[83005]: DEBUG oslo_db.sqlalchemy.engines [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 15:06:02 devstack cinder-volume[83005]: DEBUG dbcounter [-] [83005] Writer thread running {{(pid=83005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 15:06:02 devstack cinder-volume[83005]: INFO cinder.rpc [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 17 15:06:02 devstack cinder-volume[83005]: INFO cinder.rpc [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 17 15:06:02 devstack cinder-volume[83005]: DEBUG oslo_db.sqlalchemy.engines [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 15:06:02 devstack cinder-volume[83005]: INFO cinder.volume.manager [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Determined volume DB was empty at startup.
Sep 17 15:06:02 devstack cinder-volume[83005]: DEBUG cinder.volume.manager [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83005) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 17 15:06:02 devstack cinder-volume[83005]: INFO cinder.volume.manager [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 17 15:06:02 devstack cinder-volume[83005]: WARNING stevedore.named [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 17 15:06:02 devstack cinder-volume[83005]: WARNING castellan.key_manager [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 15:06:02 devstack cinder-volume[83005]: WARNING cinder.keymgr.conf_key_mgr [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 15:06:02 devstack cinder-volume[83005]: INFO cinder.volume.manager [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 17 15:06:02 devstack cinder-volume[83005]: DEBUG oslo_db.sqlalchemy.engines [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 15:06:02 devstack cinder-volume[83005]: INFO oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Starting 1 workers
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Started child 83214 {{(pid=83005) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Full set of CONF: {{(pid=83005) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] ******************************************************************************** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Configuration options gathered from: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] ================================================================================ {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 17 15:06:03 devstack cinder-volume[83214]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] allow_availability_zone_fallback = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] allow_compression_on_image_upload = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] allowed_direct_url_schemes     = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] api_rate_limit                 = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] auth_strategy                  = keystone {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_availability_zone      = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_host                   = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_name                   = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_stats_polling_interval = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backup_api_class               = cinder.backup.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backup_name_template           = backup-%s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backup_use_same_host           = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backup_use_temp_snapshot       = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] chap_password                  = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] chap_username                  =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cinder_internal_tenant_project_id = c4ffca5ab731406e825c38a85472d426 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cinder_internal_tenant_user_id = 352ed0678cca4590b747267afc45a05c {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cluster                        = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] compression_format             = gzip {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] config_dir                     = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] config_source                  = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] control_exchange               = openstack {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] debug                          = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] default_availability_zone      = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] default_group_type             = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] default_volume_type            = QuobyteHD {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] driver_client_cert             = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] driver_client_cert_key         = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] driver_data_namespace          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] driver_ssl_cert_path           = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] driver_ssl_cert_verify         = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] driver_use_ssl                 = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] enable_new_services            = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] enable_unsupported_driver      = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] enforce_multipath_for_image_xfer = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] filter_function                = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_api_insecure            = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_api_servers             = ['http://192.168.122.203/image'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_api_ssl_compression     = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_ca_certificates_file    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_certfile                = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_keyfile                 = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_num_retries             = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance_request_timeout         = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] goodness_function              = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] graceful_shutdown_timeout      = 5 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] group_api_class                = cinder.group.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] host                           = devstack {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_compress_on_upload       = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_conversion_address_space_limit = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_conversion_cpu_limit     = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_conversion_disable       = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_upload_use_cinder_backend = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_upload_use_internal_tenant = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_volume_cache_enabled     = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_volume_cache_max_count   = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] image_volume_cache_max_size_gb = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] init_host_max_objects_retrieval = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] iscsi_iotype                   = fileio {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] iscsi_target_flags             =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] iscsi_write_cache              = on {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] iser_helper                    = tgtadm {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] iser_ip_address                = 192.168.122.203 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] iser_port                      = 3260 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] log_color                      = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] log_config_append              = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] log_dir                        = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] log_file                       = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] log_options                    = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] log_rotate_interval            = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] log_rotate_interval_type       = days {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] log_rotation_type              = none {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] max_age                        = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] max_logfile_count              = 30 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] max_logfile_size_mb            = 200 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] max_over_subscription_ratio    = 20.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] message_reap_interval          = 86400 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] message_ttl                    = 2592000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] migration_create_volume_timeout_secs = 300 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] monkey_patch                   = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] monkey_patch_modules           = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] my_ip                          = 192.168.122.203 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] no_snapshot_gb_quota           = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] num_iser_scan_tries            = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] num_shell_tries                = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] num_volume_device_scan_tries   = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] nvmeof_conn_info_version       = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] nvmet_ns_id                    = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] nvmet_port_id                  = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] osapi_max_limit                = 1000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] osapi_volume_ext_list          = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] osapi_volume_listen_port       = 8776 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] osapi_volume_use_ssl           = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] osapi_volume_workers           = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] per_volume_size_limit          = -1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] periodic_fuzzy_delay           = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] periodic_interval              = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] public_endpoint                = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] publish_errors                 = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] quota_backup_gigabytes         = 1000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] quota_backups                  = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] quota_gigabytes                = 1000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] quota_groups                   = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] quota_snapshots                = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] quota_volumes                  = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] rate_limit_burst               = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] rate_limit_except_level        = CRITICAL {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] rate_limit_interval            = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] reinit_driver_count            = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] replication_device             = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] report_discard_supported       = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] report_interval                = 120 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] reservation_clean_interval     = 86400 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] reservation_expire             = 86400 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] reserved_image_namespaces      = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] reserved_percentage            = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] rpc_response_timeout           = 120 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] run_external_periodic_tasks    = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] scst_target_driver             = iscsi {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] scst_target_iqn_name           = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_down_time              = 720 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] shell_completion               = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] snapshot_name_template         = snapshot-%s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] split_loggers                  = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] state_path                     = /opt/stack/data/cinder {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] storage_availability_zone      = nova {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] storage_protocol               = iSCSI {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] syslog_log_facility            = LOG_USER {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] target_helper                  = lioadm {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] target_ip_address              = 192.168.122.203 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] target_port                    = 3260 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] target_protocol                = iscsi {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] target_secondary_ip_addresses  = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] trace_flags                    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] transport_url                  = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] until_refresh                  = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] use_chap_auth                  = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] use_default_quota_class        = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] use_journal                    = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] use_json                       = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] use_multipath_for_image_xfer   = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] use_stderr                     = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] use_syslog                     = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] verify_glance_signatures       = enabled {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_api_class               = cinder.volume.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_backend_name            = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_clear                   = zero {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_clear_ionice            = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_clear_size              = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_copy_bps_limit          = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_dd_blocksize            = 1M {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_name_template           = volume-%s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_service_inithost_offload = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volume_usage_audit_period      = month {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] watch_log_file                 = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] zoning_mode                    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_concurrency.disable_process_locking = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.admin_password = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.admin_token = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.admin_user  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.auth_protocol = https {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.auth_section = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.auth_type   = password {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.auth_uri    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.auth_version = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.cache       = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.certfile    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.identity_uri = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.include_service_catalog = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.insecure    = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.interface   = public {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.keyfile     = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_password =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcache_username =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.region_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.service_type = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.backend                  = dogpile.cache.null {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.backend_argument         = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.backend_expiration_time  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.config_prefix            = cache.oslo {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.dead_timeout             = 60.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.debug_cache_backend      = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.enable_retry_client      = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.enable_socket_keepalive  = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.enabled                  = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.enforce_fips_mode        = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.expiration_time          = 600 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.hashclient_retry_attempts = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_dead_retry      = 300 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_password        = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_sasl_enabled    = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.memcache_username        = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.proxies                  = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.redis_db                 = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.redis_password           = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.redis_server             = localhost:6379 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.redis_socket_timeout     = 1.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.redis_username           = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.retry_attempts           = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.retry_delay              = 0.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.socket_keepalive_count   = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.socket_keepalive_idle    = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.socket_keepalive_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.tls_allowed_ciphers      = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.tls_cafile               = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.tls_certfile             = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.tls_enabled              = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cache.tls_keyfile              = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] coordination.backend_url       = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.asyncio_connection    = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.asyncio_slave_connection = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.backend               = sqlalchemy {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.connection            = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.connection_debug      = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.connection_parameters =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.connection_recycle_time = 3600 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.connection_trace      = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.db_inc_retry_interval = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.db_max_retries        = 20 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.db_max_retry_interval = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.db_retry_interval     = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.max_overflow          = 50 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.max_pool_size         = 5 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.max_retries           = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.mysql_wsrep_sync_wait = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.pool_timeout          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.retry_interval        = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.slave_connection      = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.sqlite_synchronous    = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] database.use_db_reconnect      = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.connection_string     = messaging:// {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.enabled               = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.es_doc_type           = notification {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.es_scroll_size        = 10000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.es_scroll_time        = 2m {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.filter_error_trace    = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.hmac_keys             = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.sentinel_service_name = mymaster {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.socket_timeout        = 0.1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.trace_requests        = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler.trace_sqlalchemy      = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler_jaeger.process_tags   = {} {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler_jaeger.service_name_prefix = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] profiler_otlp.service_name_prefix = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.enforce_new_defaults = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:06:03 devstack cinder-volume[83005]: WARNING oslo_config.cfg [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.enforce_scope      = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.policy_default_rule = default {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] privsep_osbrick.group          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] privsep_osbrick.helper_command = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] privsep_osbrick.user           = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cinder_sys_admin.group         = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cinder_sys_admin.helper_command = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] cinder_sys_admin.user          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.auth_section      = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.auth_type         = password {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.certfile          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.collect_timing    = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.insecure          = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.keyfile           = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.send_service_user_token = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.split_loggers     = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] service_user.timeout           = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance.auth_section            = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance.auth_type               = password {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance.certfile                = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance.collect_timing          = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance.insecure                = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance.keyfile                 = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance.split_loggers           = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] glance.timeout                 = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.backend_availability_zone = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.chap_password = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.chap_username =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.driver_client_cert = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.driver_client_cert_key = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.driver_data_namespace = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.driver_use_ssl = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.extra_capabilities = {} {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.filter_function = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.goodness_function = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.iscsi_target_flags =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.iscsi_write_cache = on {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.iser_ip_address = 192.168.122.203 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.iser_port     = 3260 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_host      =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_login     = admin {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_mount_options = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_password  = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_private_key =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_share_path =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.num_shell_tries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83214) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.quobyte_volume_url = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.replication_device = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.report_discard_supported = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.reserved_percentage = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.target_helper = tgtadm {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.target_ip_address = 192.168.122.203 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.target_port   = 3260 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.target_protocol = iscsi {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.trace_flags   = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.unique_fqdn_network = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.use_chap_auth = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.volume_backend_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.volume_clear  = zero {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.volume_clear_ionice = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.volume_clear_size = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_reports.file_event_handler = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_reports.log_dir           = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.backend_availability_zone = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.backend_host         = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.chap_password        = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.chap_username        = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.driver_client_cert   = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.driver_data_namespace = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.extra_capabilities   = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.filter_function      = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.goodness_function    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.iscsi_iotype         = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.iser_helper          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.iser_ip_address      = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.iser_port            = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_host             = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_login            = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_mount_options    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_password         = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_private_key      = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_share_path       = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.num_shell_tries      = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.replication_device   = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.report_discard_supported = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.reserved_percentage  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.scst_target_driver   = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.storage_protocol     = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.target_helper        = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.target_ip_address    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.target_port          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.target_prefix        = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.target_protocol      = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.trace_flags          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.use_chap_auth        = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.volume_clear         = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.volume_clear_size    = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] QuobyteHD.volumes_dir          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_notifications.driver = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_notifications.retry = -1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] key_manager.fixed_key          = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.barbican_api_version  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.barbican_endpoint     = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.barbican_endpoint_type = public {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.barbican_region_name  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.cafile                = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.certfile              = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.collect_timing        = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.insecure              = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.keyfile               = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.number_of_retries     = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.retry_delay           = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.send_service_user_token = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.split_loggers         = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.timeout               = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.verify_ssl            = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican.verify_ssl_path       = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican_service_user.auth_section = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican_service_user.auth_type = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican_service_user.cafile   = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican_service_user.certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican_service_user.collect_timing = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican_service_user.insecure = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican_service_user.keyfile  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican_service_user.split_loggers = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:03 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] barbican_service_user.timeout  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.approle_role_id          = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.approle_secret_id        = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.kv_mountpoint            = secret {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.kv_path                  = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.kv_version               = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.namespace                = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.root_token_id            = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.ssl_ca_crt_file          = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.timeout                  = 60.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.use_ssl                  = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 15:06:04 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-b2cc5054-fdb9-4dc9-aff6-8a06321f3ad0 None None] ******************************************************************************** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 17 15:06:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83214) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 17 15:06:04 devstack cinder-volume[83214]: INFO cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 17 15:06:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Running cmd (subprocess): mount.quobyte {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:06:04 devstack quobyte-client[83227]: Reading configuration file: /etc/quobyte/client.cfg
Sep 17 15:06:04 devstack quobyte-client[83227]: Invalid parameters found, error: missing mount point.
Sep 17 15:06:04 devstack quobyte-client[83227]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 17 15:06:04 devstack quobyte-client[83227]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 17 15:06:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] CMD "mount.quobyte" returned: 1 in 0.307s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:06:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:06:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:06:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:06:04 devstack cinder-volume[83214]: INFO cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Mounting volume: 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 ...
Sep 17 15:06:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e -c /etc/quobyte/client-cinder.cfg {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:06:04 devstack quobyte-client[83233]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 17 15:06:04 devstack quobyte-client[83233]: Reading configuration file: /etc/quobyte/client.cfg
Sep 17 15:06:04 devstack quobyte-client[83233]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e' to display the log.
Sep 17 15:06:04 devstack quobyte-client[83236]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 17 15:06:04 devstack quobyte-client[83236]: mount.quobyte 3.25 (4fbbd59204)
Sep 17 15:06:04 devstack quobyte-client[83236]: Client UUID: UAa33RM2-IwLP-hre9-gRAR-WyzJn1sLTRlp
Sep 17 15:06:04 devstack quobyte-client[83236]: Registry: osci01.corp.quobyte.com:7861
Sep 17 15:06:04 devstack quobyte-client[83236]: Volume: cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:06:04 devstack quobyte-client[83236]: FUSE version: 316
Sep 17 15:06:04 devstack quobyte-client[83236]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 17 15:06:04 devstack quobyte-client[83236]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 17 15:06:04 devstack quobyte-client[83236]: Setting total object cache size to 3352297472 bytes
Sep 17 15:06:04 devstack quobyte-client[83236]: Using FUSE low-level API
Sep 17 15:06:04 devstack quobyte-client[83236]: Caching of uid/gid to user/group name mappings is enabled
Sep 17 15:06:04 devstack quobyte-client[83236]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 17 15:06:04 devstack quobyte-client[83236]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 17 15:06:04 devstack quobyte-client[83236]: HTTP server started on port 55000
Sep 17 15:06:04 devstack quobyte-client[83236]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 17 15:06:04 devstack quobyte-client[83236]: Mount point /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e established
Sep 17 15:06:04 devstack quobyte-client[83236]: TimeSync is running and remote sync every 60 seconds
Sep 17 15:06:05 devstack quobyte-client[83236]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 15:06:05 devstack quobyte-client[83236]: Ignored time synchronization message because time source took too long to respond (56 ms)
Sep 17 15:06:05 devstack quobyte-client[83236]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 15:06:05 devstack quobyte-client[83236]: Opening volume cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 (c7001698-d85a-4237-9fdf-98dab0229404)
Sep 17 15:06:05 devstack quobyte-client[83236]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 17 15:06:05 devstack quobyte-client[83236]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 15:06:05 devstack quobyte-client[83236]: Failed to invalidate inode: 38: Function not implemented
Sep 17 15:06:05 devstack quobyte-client[83236]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 15:06:05 devstack quobyte-client[83236]: Automatic minidump upload enabled by global system configuration
Sep 17 15:06:05 devstack quobyte-client[83236]: Announcing HTTP status server address 172.24.4.1
Sep 17 15:06:05 devstack quobyte-client[83236]: Registered as service (uuid UAa33RM2-IwLP-hre9-gRAR-WyzJn1sLTRlp)
Sep 17 15:06:05 devstack quobyte-client[83236]: Quobyte Client running as pid 83236
Sep 17 15:06:05 devstack quobyte-client[83236]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 17 15:06:05 devstack quobyte-client[83236]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.680s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:06:05 devstack cinder-volume[83214]: INFO cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Mounting volume: 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 succeeded
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.741s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:06:05 devstack quobyte-client[83236]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.080s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:06:05 devstack cinder-volume[83214]: INFO cinder.volume.driver [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Driver hasn't implemented _init_vendor_properties()
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG cinder.volume.driver [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154777526855, 'free_capacity_gb': 924.9154777526855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83214) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_db.sqlalchemy.engines [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writer thread running {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG cinder.db.sqlalchemy.api [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Building query based on filter {{(pid=83214) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83214) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 17 15:06:05 devstack cinder-volume[83214]: INFO cinder.keymgr.migration [None req-8bc005e4-df93-405c-bac2-ad26f8687512 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.074s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:06:05 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:06:06 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Driver initialization completed successfully.
Sep 17 15:06:06 devstack cinder-volume[83214]: INFO cinder.manager [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Initiating service 3 cleanup
Sep 17 15:06:06 devstack cinder-volume[83214]: INFO cinder.manager [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Service 3 cleanup completed.
Sep 17 15:06:06 devstack cinder-volume[83214]: DEBUG cinder.service [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Creating RPC server for service cinder-volume {{(pid=83214) start /opt/stack/cinder/cinder/service.py:239}}
Sep 17 15:06:06 devstack cinder-volume[83214]: DEBUG cinder.service [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83214) start /opt/stack/cinder/cinder/service.py:245}}
Sep 17 15:06:06 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 17 15:06:06 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:06:06 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:06:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:06:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:06:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:06:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:06:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:06:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:06:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.093s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:06:06 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9e026a11-130d-4f1f-b490-e2d64f8e9d13 None None] Driver post RPC initialization completed successfully.
Sep 17 15:06:07 devstack quobyte-client[83236]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 15:06:12 devstack cinder-volume[83005]: DEBUG dbcounter [-] [83005] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:06:16 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:06:16 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:07:05 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:07:05 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:07:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Flow 'volume_create_manager' (2e044dff-c1cc-4aa4-911d-d937c1d73bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:07:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51717aa4-0d00-46b9-9cf0-8f2dffc5db10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51717aa4-0d00-46b9-9cf0-8f2dffc5db10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1936759663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c2c831-e7c5-4ad5-833d-91240109c8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b8098913484784bc015c214d9a90e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:07:05Z,use_quota=True,user_id='53830294dceb41dc90a9c4e50d306f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a0ec31-1ab1-4f0c-aa67-64db077e3a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a0ec31-1ab1-4f0c-aa67-64db077e3a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59810656-9fe6-405f-9a2c-77cb44900815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:05 devstack cinder-volume[83214]: DEBUG cinder.image.glance [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Creating Keystone auth plugin from conf {{(pid=83214) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 15:07:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59810656-9fe6-405f-9a2c-77cb44900815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '52c2c831-e7c5-4ad5-833d-91240109c8f1', 'volume_name': 'volume-52c2c831-e7c5-4ad5-833d-91240109c8f1', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4b37e3df0>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594adac2-f7e6-49ae-b423-ee3a0ff6881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594adac2-f7e6-49ae-b423-ee3a0ff6881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cfd296-a2dd-40e7-a492-b1238dbad302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:06 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Volume 52c2c831-e7c5-4ad5-833d-91240109c8f1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-52c2c831-e7c5-4ad5-833d-91240109c8f1', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4b37e3df0>}
Sep 17 15:07:06 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Cloning 52c2c831-e7c5-4ad5-833d-91240109c8f1 from image 1365088a-6d64-46d1-8e72-c667035bafb6  at location (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]). {{(pid=83214) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 15:07:09 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD, size 20.69 MB, duration 3.07 sec {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 15:07:09 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Image download 20.69 MB at 6.73 MB/s
Sep 17 15:07:09 devstack cinder-volume[83214]: INFO oslo.privsep.daemon [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp845l8p4i/privsep.sock']
Sep 17 15:07:09 devstack sudo[83519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp845l8p4i/privsep.sock
Sep 17 15:07:09 devstack sudo[83519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:07:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:07:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:07:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:07:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:07:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:07:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:07:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.170s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:11 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:07:14 devstack sudo[83519]: pam_unix(sudo:session): session closed for user root
Sep 17 15:07:14 devstack cinder-volume[83214]: INFO oslo.privsep.daemon [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Spawned new privsep daemon via rootwrap
Sep 17 15:07:14 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Accepted privsep connection to /tmp/tmp845l8p4i/privsep.sock {{(pid=83214) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 17 15:07:14 devstack cinder-volume[83214]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 17 15:07:14 devstack cinder-volume[83214]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 17 15:07:14 devstack cinder-volume[83214]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 17 15:07:14 devstack cinder-volume[83214]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83527
Sep 17 15:07:14 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[05212f26-6370-41d0-b8c7-1733c427b522]: (2,) {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:07:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:07:14 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:07:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Flow 'volume_create_manager' (9a9972e8-cea7-421d-99e1-e2e883628ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:07:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550fbeac-eada-4329-9f1e-a9bb0485a2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:14 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0757d1b0-299d-436f-8173-7f873e98cdfb]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:07:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550fbeac-eada-4329-9f1e-a9bb0485a2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-179364559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9733a82-c85d-4642-a7f1-93f9eaff9ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687140a5ff50433a9eefade3045901a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:07:14Z,use_quota=True,user_id='c296371f54a44108b783534777954279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448673af-26d9-4fd4-882f-decdb8963422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448673af-26d9-4fd4-882f-decdb8963422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1cfb6b-f934-4b35-bac1-8e9782c44d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1cfb6b-f934-4b35-bac1-8e9782c44d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9733a82-c85d-4642-a7f1-93f9eaff9ad6', 'volume_name': 'volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a1ea13-a342-47d4-a59f-eec8ffc41e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a1ea13-a342-47d4-a59f-eec8ffc41e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957eacf6-df46-4048-ba7b-7f14c6c76458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:15 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Volume b9733a82-c85d-4642-a7f1-93f9eaff9ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6', 'volume_size': 1}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-179364559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9733a82-c85d-4642-a7f1-93f9eaff9ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687140a5ff50433a9eefade3045901a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:07:14Z,use_quota=True,user_id='c296371f54a44108b783534777954279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Creating volume b9733a82-c85d-4642-a7f1-93f9eaff9ad6 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:07:15 devstack sudo[83531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:07:15 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:07:15 devstack sudo[83531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:07:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:15 devstack quobyte-client[83236]: System call of process 83533 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:07:15 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=2, name=volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:07:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6 1073741824" returned: 0 in 0.741s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6" returned: 0 in 0.280s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] <== create_volume: return (1150ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:07:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:07:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957eacf6-df46-4048-ba7b-7f14c6c76458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a075eac-c4bf-4f8a-99e6-fee46e209e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:16 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Volume volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6 (b9733a82-c85d-4642-a7f1-93f9eaff9ad6): created successfully
Sep 17 15:07:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a075eac-c4bf-4f8a-99e6-fee46e209e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Flow 'volume_create_manager' (9a9972e8-cea7-421d-99e1-e2e883628ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:07:16 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-64c88d2e-397a-420e-8b3a-8abe69eb70d3 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Created volume successfully.
Sep 17 15:07:17 devstack sudo[83531]: pam_unix(sudo:session): session closed for user root
Sep 17 15:07:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD" returned: 0 in 2.912s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:17 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Temporary image 1365088a-6d64-46d1-8e72-c667035bafb6 is fetched for user 53830294dceb41dc90a9c4e50d306f25. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 15:07:17 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f64d80e-c7cf-4ade-a1fe-9acede05cee2]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:07:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:18 devstack sudo[83853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD
Sep 17 15:07:18 devstack sudo[83853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:07:21 devstack sudo[83853]: pam_unix(sudo:session): session closed for user root
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD" returned: 0 in 3.392s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1936759663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c2c831-e7c5-4ad5-833d-91240109c8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b8098913484784bc015c214d9a90e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:07:05Z,use_quota=True,user_id='53830294dceb41dc90a9c4e50d306f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Creating volume 52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:07:21 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:07:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:21 devstack quobyte-client[83236]: System call of process 83861 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:07:21 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=3, name=volume-52c2c831-e7c5-4ad5-833d-91240109c8f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:07:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 1073741824" returned: 0 in 0.535s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1" returned: 0 in 0.312s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] <== create_volume: return (1026ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:07:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:07:23 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Attempting download of 1365088a-6d64-46d1-8e72-c667035bafb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}])) to volume 52c2c831-e7c5-4ad5-833d-91240109c8f1. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 15:07:23 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f5111-f938-4f4f-a884-18f27205deab]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:07:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_n8pyod69 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_n8pyod69" returned: 0 in 0.589s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_n8pyod69 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_n8pyod69" returned: 1 in 0.602s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_n8pyod69' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:07:24 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8876715c-2d78-47e7-adbb-138ac15c07e0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:07:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD" returned: 0 in 1.066s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:25 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] 1365088a-6d64-46d1-8e72-c667035bafb6 was qcow2, converting to raw {{(pid=83214) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 15:07:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:26 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=3, name=volume-52c2c831-e7c5-4ad5-833d-91240109c8f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:07:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1" returned: 0 in 1.341s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:27 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_8_madw9sdevstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:07:27 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Converted 112.00 MB image at 80.30 MB/s
Sep 17 15:07:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 1G" returned: 0 in 0.220s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:27 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e8cc9e-0c61-41f9-80c6-2d0c81d8e20e]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:07:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1" returned: 0 in 0.604s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1" returned: 1 in 0.758s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Downloaded image 1365088a-6d64-46d1-8e72-c667035bafb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}])) to volume 52c2c831-e7c5-4ad5-833d-91240109c8f1 successfully. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Temporary image 1365088a-6d64-46d1-8e72-c667035bafb6 for user 53830294dceb41dc90a9c4e50d306f25 is deleted. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Marking volume 52c2c831-e7c5-4ad5-833d-91240109c8f1 as bootable. {{(pid=83214) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Copying metadata from image 1365088a-6d64-46d1-8e72-c667035bafb6 to 52c2c831-e7c5-4ad5-833d-91240109c8f1. {{(pid=83214) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Creating volume glance metadata for volume 52c2c831-e7c5-4ad5-833d-91240109c8f1 backed by image 1365088a-6d64-46d1-8e72-c667035bafb6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83214) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cfd296-a2dd-40e7-a492-b1238dbad302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c2c831-e7c5-4ad5-833d-91240109c8f1', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4b37e3df0>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d436b5-7519-46a9-a294-97f28c3b7683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:29 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Volume volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 (52c2c831-e7c5-4ad5-833d-91240109c8f1): created successfully
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d436b5-7519-46a9-a294-97f28c3b7683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Flow 'volume_create_manager' (2e044dff-c1cc-4aa4-911d-d937c1d73bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:07:29 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-49ce44ea-0327-4ce1-84ce-3d9533246ba1 tempest-TaggedBootDevicesTest-1243970107 None] Created volume successfully.
Sep 17 15:07:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Flow 'volume_create_manager' (7ec6f367-28ae-400b-84ad-8a202142d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4faf5e7d-1b43-44ab-a7b1-c4d0c8447713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4faf5e7d-1b43-44ab-a7b1-c4d0c8447713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1699827122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2efed7d1-026b-413f-b1c3-d3931ee090a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b8098913484784bc015c214d9a90e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:07:31Z,use_quota=True,user_id='53830294dceb41dc90a9c4e50d306f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0d86bd-c20a-480a-94ca-6b60088b0def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0d86bd-c20a-480a-94ca-6b60088b0def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08efe141-2534-4ddd-830e-372e721976d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08efe141-2534-4ddd-830e-372e721976d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2efed7d1-026b-413f-b1c3-d3931ee090a6', 'volume_name': 'volume-2efed7d1-026b-413f-b1c3-d3931ee090a6', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49ce6fe-128c-4c96-8ada-843ad78e0e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49ce6fe-128c-4c96-8ada-843ad78e0e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b61c8c-50a6-4bf4-8838-1867b0ff6d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:30 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Volume 2efed7d1-026b-413f-b1c3-d3931ee090a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2efed7d1-026b-413f-b1c3-d3931ee090a6', 'volume_size': 1}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1699827122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2efed7d1-026b-413f-b1c3-d3931ee090a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b8098913484784bc015c214d9a90e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:07:31Z,use_quota=True,user_id='53830294dceb41dc90a9c4e50d306f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Creating volume 2efed7d1-026b-413f-b1c3-d3931ee090a6 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:07:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:07:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:07:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:07:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:07:31 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:07:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:31 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=4, name=volume-2efed7d1-026b-413f-b1c3-d3931ee090a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:07:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6 1073741824" returned: 0 in 0.579s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6" returned: 0 in 0.162s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] <== create_volume: return (969ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:07:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:07:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b61c8c-50a6-4bf4-8838-1867b0ff6d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2efed7d1-026b-413f-b1c3-d3931ee090a6', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bb81b5-d8bb-43ad-9e7e-7acc2d2fbf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:32 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Volume volume-2efed7d1-026b-413f-b1c3-d3931ee090a6 (2efed7d1-026b-413f-b1c3-d3931ee090a6): created successfully
Sep 17 15:07:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bb81b5-d8bb-43ad-9e7e-7acc2d2fbf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Flow 'volume_create_manager' (7ec6f367-28ae-400b-84ad-8a202142d19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:07:32 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-56f4c6e4-2ba9-472d-92cb-0a8fa2d7b993 tempest-TaggedBootDevicesTest-1243970107 None] Created volume successfully.
Sep 17 15:07:34 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Flow 'volume_create_manager' (6ddded1f-d5da-4f68-9b76-a24a27b03551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d6ef4f-e712-4294-adf4-baac26128a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d6ef4f-e712-4294-adf4-baac26128a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-712355077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe1380c-943b-4f9f-a54d-57a25219ac5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b8098913484784bc015c214d9a90e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:07:34Z,use_quota=True,user_id='53830294dceb41dc90a9c4e50d306f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3b0f58-0e48-4f44-b8d6-0125e3bb43d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3b0f58-0e48-4f44-b8d6-0125e3bb43d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8524467e-8df5-4d2a-adca-2122602a3862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8524467e-8df5-4d2a-adca-2122602a3862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe1380c-943b-4f9f-a54d-57a25219ac5a', 'volume_name': 'volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1aee22-365c-491e-912c-9c33a8eac374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1aee22-365c-491e-912c-9c33a8eac374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aba0ab5-41d0-461e-bd8c-738eca3ab5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:34 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Volume 8fe1380c-943b-4f9f-a54d-57a25219ac5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a', 'volume_size': 1}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-712355077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe1380c-943b-4f9f-a54d-57a25219ac5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b8098913484784bc015c214d9a90e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:07:34Z,use_quota=True,user_id='53830294dceb41dc90a9c4e50d306f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Creating volume 8fe1380c-943b-4f9f-a54d-57a25219ac5a {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:07:34 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:07:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:34 devstack quobyte-client[83236]: System call of process 83934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:07:34 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=5, name=volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:07:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a 1073741824" returned: 0 in 0.657s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:07:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a" returned: 0 in 0.366s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:07:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] <== create_volume: return (1292ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:07:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:07:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aba0ab5-41d0-461e-bd8c-738eca3ab5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23dd081-c3a3-4851-bbf0-77cdc1e37b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:07:35 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Volume volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a (8fe1380c-943b-4f9f-a54d-57a25219ac5a): created successfully
Sep 17 15:07:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23dd081-c3a3-4851-bbf0-77cdc1e37b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:07:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Flow 'volume_create_manager' (6ddded1f-d5da-4f68-9b76-a24a27b03551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:07:36 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c0fe490d-5208-4207-ac5c-7a14440a7e42 tempest-TaggedBootDevicesTest-1243970107 None] Created volume successfully.
Sep 17 15:07:46 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:07:46 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:DELETE=3,cinder:INSERT=7 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:08:06 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Flow 'volume_create_manager' (e718ec41-5279-44b4-88ba-63c5faa525f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b464a9-e733-48ec-b245-6576a5b60f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b464a9-e733-48ec-b245-6576a5b60f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1588874330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed171ead-b85c-458e-a097-621867bf5d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0692dff29774ebc88c3ade9b7ed46d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:08:06Z,use_quota=True,user_id='567a590d7e6244d58f6ca7cea29701d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b52494b-a2c8-4100-9b92-de9f20bbb948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b52494b-a2c8-4100-9b92-de9f20bbb948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe404e6a-4da0-4d8e-b994-2e658e1c1507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe404e6a-4da0-4d8e-b994-2e658e1c1507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed171ead-b85c-458e-a097-621867bf5d48', 'volume_name': 'volume-ed171ead-b85c-458e-a097-621867bf5d48', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9f9b3a-375e-4656-a505-66b15b5a1c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9f9b3a-375e-4656-a505-66b15b5a1c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31e13f9-aff2-4c44-9466-77d47a630695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:08:06 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Volume ed171ead-b85c-458e-a097-621867bf5d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed171ead-b85c-458e-a097-621867bf5d48', 'volume_size': 1}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1588874330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed171ead-b85c-458e-a097-621867bf5d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0692dff29774ebc88c3ade9b7ed46d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:08:06Z,use_quota=True,user_id='567a590d7e6244d58f6ca7cea29701d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Creating volume ed171ead-b85c-458e-a097-621867bf5d48 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:08:06 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:08:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed171ead-b85c-458e-a097-621867bf5d48 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:07 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=6, name=volume-ed171ead-b85c-458e-a097-621867bf5d48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:08:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed171ead-b85c-458e-a097-621867bf5d48 1073741824" returned: 0 in 1.914s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed171ead-b85c-458e-a097-621867bf5d48 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed171ead-b85c-458e-a097-621867bf5d48" returned: 0 in 0.497s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] <== create_volume: return (2683ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:08:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.729s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:08:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31e13f9-aff2-4c44-9466-77d47a630695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed171ead-b85c-458e-a097-621867bf5d48', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:08:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ab49dd-e326-4f87-bbb0-2f178a4ffb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:08:10 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Volume volume-ed171ead-b85c-458e-a097-621867bf5d48 (ed171ead-b85c-458e-a097-621867bf5d48): created successfully
Sep 17 15:08:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ab49dd-e326-4f87-bbb0-2f178a4ffb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:08:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Flow 'volume_create_manager' (e718ec41-5279-44b4-88ba-63c5faa525f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:08:10 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-92aaeea7-80c7-436a-a598-26c00d41c083 tempest-VolumesAdminNegativeTest-1511646891 None] Created volume successfully.
Sep 17 15:08:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:08:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:08:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:08:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:08:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:08:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:08:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.538s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:08:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Acquiring lock "cinder-ed171ead-b85c-458e-a097-621867bf5d48-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:08:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "cinder-ed171ead-b85c-458e-a097-621867bf5d48-delete_volume" acquired by "delete_volume" :: waited 0.549s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:08:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:08:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Acquiring lock "cinder-quobyte-ed171ead-b85c-458e-a097-621867bf5d48" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:08:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "cinder-quobyte-ed171ead-b85c-458e-a097-621867bf5d48" acquired by "delete_volume" :: waited 0.080s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:08:15 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d709297d-f319-4e6d-b278-f02fa3cfae17]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:08:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed171ead-b85c-458e-a097-621867bf5d48 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:17 devstack quobyte-client[83236]: System call of process 84145 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:08:17 devstack quobyte-client[83236]: System call of process 84145 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:08:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed171ead-b85c-458e-a097-621867bf5d48" returned: 0 in 2.546s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed171ead-b85c-458e-a097-621867bf5d48 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed171ead-b85c-458e-a097-621867bf5d48" returned: 0 in 0.415s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "cinder-quobyte-ed171ead-b85c-458e-a097-621867bf5d48" released by "delete_volume" :: held 3.723s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:08:21 devstack cinder-volume[83214]: WARNING cinder.quota [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:08:21 devstack cinder-volume[83214]: WARNING cinder.quota [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:08:21 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Created reservations ['e7ef9910-f4ef-49d3-8897-7bff7391c914', '70fbf2fe-950a-4f96-b233-13722ee4b0d8', 'd76f8a8b-dc56-47bc-a602-d058b614038c', '367702eb-0099-4e95-b4b7-bd4899bf1e21'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:08:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:08:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.037s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:08:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:08:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:08:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.108s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:08:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.562s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:24 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:08:25 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Deleted volume successfully.
Sep 17 15:08:27 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e536c261-b3ee-4008-81b9-012c2e853846 tempest-VolumesAdminNegativeTest-1511646891 None] Lock "cinder-ed171ead-b85c-458e-a097-621867bf5d48-delete_volume" released by "delete_volume" :: held 13.021s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:08:33 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=9,cinder:UPDATE=18,cinder:INSERT=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:08:37 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=2,cinder:INSERT=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:08:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:08:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:08:37 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f864f-7eb7-4ac2-88e0-d75420a11cbf]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:08:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1" returned: 0 in 1.247s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1" returned: 1 in 0.959s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:08:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.633s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:08:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-52c2c831-e7c5-4ad5-833d-91240109c8f1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '244f8850-1b0d-43f6-964d-62c3081d5adc', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:08:41 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:08:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-18216c1d-72e6-4424-a3c7-616305eb263a req-e00dc491-556b-4bcf-9e2c-9085cf8d0e35 tempest-TaggedBootDevicesTest-1243970107 None] attachment_update completed successfully.
Sep 17 15:08:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-ceee4dad-7853-411c-82ad-19ded1e1f2e4 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:08:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-ceee4dad-7853-411c-82ad-19ded1e1f2e4 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:08:46 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec0115-8a4e-4ab8-ae6f-0f0db3625e0b]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:08:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-ceee4dad-7853-411c-82ad-19ded1e1f2e4 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:47 devstack quobyte-client[83236]: System call of process 84374 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:08:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-ceee4dad-7853-411c-82ad-19ded1e1f2e4 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6" returned: 0 in 0.894s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-ceee4dad-7853-411c-82ad-19ded1e1f2e4 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.947s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:08:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-18216c1d-72e6-4424-a3c7-616305eb263a req-ceee4dad-7853-411c-82ad-19ded1e1f2e4 tempest-TaggedBootDevicesTest-1243970107 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-2efed7d1-026b-413f-b1c3-d3931ee090a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4db0af6c-1503-4a27-a43b-45cf75c205db', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:08:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-ceee4dad-7853-411c-82ad-19ded1e1f2e4 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:08:48 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-18216c1d-72e6-4424-a3c7-616305eb263a req-ceee4dad-7853-411c-82ad-19ded1e1f2e4 tempest-TaggedBootDevicesTest-1243970107 None] attachment_update completed successfully.
Sep 17 15:08:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-c681e3a1-6d49-42f7-b16e-992f63e73abb tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:08:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-c681e3a1-6d49-42f7-b16e-992f63e73abb tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:08:51 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0eb0d0-f139-4f4a-b331-a94128edc509]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:08:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-c681e3a1-6d49-42f7-b16e-992f63e73abb tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:08:51 devstack quobyte-client[83236]: System call of process 84390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:08:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-c681e3a1-6d49-42f7-b16e-992f63e73abb tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a" returned: 0 in 0.725s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:08:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-c681e3a1-6d49-42f7-b16e-992f63e73abb tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.790s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:08:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-18216c1d-72e6-4424-a3c7-616305eb263a req-c681e3a1-6d49-42f7-b16e-992f63e73abb tempest-TaggedBootDevicesTest-1243970107 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd73e76f4-d1ce-4128-9201-8a60f4905395', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:08:52 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-18216c1d-72e6-4424-a3c7-616305eb263a req-c681e3a1-6d49-42f7-b16e-992f63e73abb tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:08:52 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-18216c1d-72e6-4424-a3c7-616305eb263a req-c681e3a1-6d49-42f7-b16e-992f63e73abb tempest-TaggedBootDevicesTest-1243970107 None] attachment_update completed successfully.
Sep 17 15:09:02 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:09:02 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:09:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:09:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:09:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:09:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:09:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:09:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:09:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:09:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.113s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:09:11 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:09:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-f6e9aaac-5182-4fb2-a02a-a12d1374f571 req-c3711b4f-c683-4a52-bae5-30790898cedc tempest-VolumesAssistedSnapshotsTest-1604937801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:09:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-f6e9aaac-5182-4fb2-a02a-a12d1374f571 req-c3711b4f-c683-4a52-bae5-30790898cedc tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:09:26 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b08f935-a839-48d5-bba1-fdcf91424f08]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:09:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-f6e9aaac-5182-4fb2-a02a-a12d1374f571 req-c3711b4f-c683-4a52-bae5-30790898cedc tempest-VolumesAssistedSnapshotsTest-1604937801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:09:29 devstack quobyte-client[83236]: System call of process 85210 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:09:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-f6e9aaac-5182-4fb2-a02a-a12d1374f571 req-c3711b4f-c683-4a52-bae5-30790898cedc tempest-VolumesAssistedSnapshotsTest-1604937801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6" returned: 0 in 2.533s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:09:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-f6e9aaac-5182-4fb2-a02a-a12d1374f571 req-c3711b4f-c683-4a52-bae5-30790898cedc tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.723s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:09:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-f6e9aaac-5182-4fb2-a02a-a12d1374f571 req-c3711b4f-c683-4a52-bae5-30790898cedc tempest-VolumesAssistedSnapshotsTest-1604937801 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d2c6816-ee7e-45b5-9a1c-d9a56a8840ae', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:09:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-f6e9aaac-5182-4fb2-a02a-a12d1374f571 req-c3711b4f-c683-4a52-bae5-30790898cedc tempest-VolumesAssistedSnapshotsTest-1604937801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:09:30 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-f6e9aaac-5182-4fb2-a02a-a12d1374f571 req-c3711b4f-c683-4a52-bae5-30790898cedc tempest-VolumesAssistedSnapshotsTest-1604937801 None] attachment_update completed successfully.
Sep 17 15:09:40 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:09:40 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:10:04 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-1e4493b4-7bfd-4897-ade3-2ee995a2dccd req-69e1a009-84d6-4a26-9cc8-cfb1199c90ad tempest-VolumesAssistedSnapshotsTest-1604937801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:10:04 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-1e4493b4-7bfd-4897-ade3-2ee995a2dccd req-69e1a009-84d6-4a26-9cc8-cfb1199c90ad tempest-VolumesAssistedSnapshotsTest-1604937801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:10:04 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-1e4493b4-7bfd-4897-ade3-2ee995a2dccd req-69e1a009-84d6-4a26-9cc8-cfb1199c90ad tempest-VolumesAssistedSnapshotsTest-1604937801 None] Terminate volume connection completed successfully.
Sep 17 15:10:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-1e4493b4-7bfd-4897-ade3-2ee995a2dccd req-69e1a009-84d6-4a26-9cc8-cfb1199c90ad tempest-VolumesAssistedSnapshotsTest-1604937801 None] Deleting attachment 6d2c6816-ee7e-45b5-9a1c-d9a56a8840ae. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:10:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Acquiring lock "cinder-b9733a82-c85d-4642-a7f1-93f9eaff9ad6-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:10:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "cinder-b9733a82-c85d-4642-a7f1-93f9eaff9ad6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:10:06 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:10:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Acquiring lock "cinder-quobyte-b9733a82-c85d-4642-a7f1-93f9eaff9ad6" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:10:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "cinder-quobyte-b9733a82-c85d-4642-a7f1-93f9eaff9ad6" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:10:06 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3213c00a-4d7d-459b-985d-fa3331e63bcb]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:10:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6" returned: 0 in 0.518s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b9733a82-c85d-4642-a7f1-93f9eaff9ad6" returned: 0 in 0.101s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "cinder-quobyte-b9733a82-c85d-4642-a7f1-93f9eaff9ad6" released by "delete_volume" :: held 0.765s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Created reservations ['a76b94ed-f8bb-4d2f-9545-620129a19442', 'cba053df-1f92-4e55-9493-ad4bdb0a5d90', '71ae5e7f-32d3-4765-9af7-2da3e6ecda69', 'c500d12c-e618-4307-b777-059a0c6b4dc5'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:10:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.117s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:08 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:10:08 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Deleted volume successfully.
Sep 17 15:10:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-df7ed31d-f069-4e5c-a4da-dd484722c685 tempest-VolumesAssistedSnapshotsTest-1604937801 None] Lock "cinder-b9733a82-c85d-4642-a7f1-93f9eaff9ad6-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:10:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:10:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:10:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.099s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:10:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:10:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:10:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.153s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:10:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.555s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:10:18 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:10:18 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:10:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Flow 'volume_create_manager' (4de2ded1-d080-4cc9-851a-5c5ef375e5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b78300-760b-44e7-b473-db43021e24d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b78300-760b-44e7-b473-db43021e24d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-574056508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1036bb2d-d746-49f8-bab5-9d853ea4d61c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f4ebd95cc764d12bef6dedc76b6e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:10:28Z,use_quota=True,user_id='9271310a39a74f24bbc8da9a39ed90ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c277be46-4149-499b-a7c0-1311e8fb2f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c277be46-4149-499b-a7c0-1311e8fb2f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c711a63a-684c-4eb2-a496-90e72bd9535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c711a63a-684c-4eb2-a496-90e72bd9535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1036bb2d-d746-49f8-bab5-9d853ea4d61c', 'volume_name': 'volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b9798c-9393-4e2a-ac8f-877872b7494d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b9798c-9393-4e2a-ac8f-877872b7494d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4eecfe6-b58d-4741-8bae-40ebb6265106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:10:28 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Volume 1036bb2d-d746-49f8-bab5-9d853ea4d61c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c', 'volume_size': 1}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-574056508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1036bb2d-d746-49f8-bab5-9d853ea4d61c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f4ebd95cc764d12bef6dedc76b6e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:10:28Z,use_quota=True,user_id='9271310a39a74f24bbc8da9a39ed90ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Creating volume 1036bb2d-d746-49f8-bab5-9d853ea4d61c {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:10:28 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:10:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:29 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=7, name=volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:10:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c 1073741824" returned: 0 in 0.925s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c" returned: 0 in 0.494s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] <== create_volume: return (1584ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:10:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:10:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4eecfe6-b58d-4741-8bae-40ebb6265106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:10:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3805a61-18fc-440f-8ada-7fe3a888dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:10:30 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Volume volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c (1036bb2d-d746-49f8-bab5-9d853ea4d61c): created successfully
Sep 17 15:10:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3805a61-18fc-440f-8ada-7fe3a888dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:10:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Flow 'volume_create_manager' (4de2ded1-d080-4cc9-851a-5c5ef375e5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:10:31 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9b6a507a-d3c4-473c-9554-630322b20d3e tempest-DeleteServersTestJSON-1498297445 None] Created volume successfully.
Sep 17 15:10:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-32ed52a7-225a-4c62-af79-03dc4c8b4c04 req-aeda0f3d-08ff-4b0a-a71c-5568d0bddfe9 tempest-DeleteServersTestJSON-1498297445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:10:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-32ed52a7-225a-4c62-af79-03dc4c8b4c04 req-aeda0f3d-08ff-4b0a-a71c-5568d0bddfe9 tempest-DeleteServersTestJSON-1498297445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:10:37 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b6161f-b91e-4596-8a35-ac14be4463f8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:10:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-32ed52a7-225a-4c62-af79-03dc4c8b4c04 req-aeda0f3d-08ff-4b0a-a71c-5568d0bddfe9 tempest-DeleteServersTestJSON-1498297445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:38 devstack quobyte-client[83236]: System call of process 85562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:10:38 devstack quobyte-client[83236]: System call of process 85562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:10:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-32ed52a7-225a-4c62-af79-03dc4c8b4c04 req-aeda0f3d-08ff-4b0a-a71c-5568d0bddfe9 tempest-DeleteServersTestJSON-1498297445 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c" returned: 0 in 0.926s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-32ed52a7-225a-4c62-af79-03dc4c8b4c04 req-aeda0f3d-08ff-4b0a-a71c-5568d0bddfe9 tempest-DeleteServersTestJSON-1498297445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.083s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:10:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-32ed52a7-225a-4c62-af79-03dc4c8b4c04 req-aeda0f3d-08ff-4b0a-a71c-5568d0bddfe9 tempest-DeleteServersTestJSON-1498297445 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76b48f34-4f1a-4c69-bf9c-23e90071f3a9', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:10:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-32ed52a7-225a-4c62-af79-03dc4c8b4c04 req-aeda0f3d-08ff-4b0a-a71c-5568d0bddfe9 tempest-DeleteServersTestJSON-1498297445 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:10:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-32ed52a7-225a-4c62-af79-03dc4c8b4c04 req-aeda0f3d-08ff-4b0a-a71c-5568d0bddfe9 tempest-DeleteServersTestJSON-1498297445 None] attachment_update completed successfully.
Sep 17 15:10:49 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=5 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:10:49 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:10:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-9702a1b7-9102-48f1-a9ff-782557f3ca8b req-12952432-c268-4709-9980-722b2ca2bee9 tempest-DeleteServersTestJSON-1498297445 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:10:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-9702a1b7-9102-48f1-a9ff-782557f3ca8b req-12952432-c268-4709-9980-722b2ca2bee9 tempest-DeleteServersTestJSON-1498297445 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:10:53 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-9702a1b7-9102-48f1-a9ff-782557f3ca8b req-12952432-c268-4709-9980-722b2ca2bee9 tempest-DeleteServersTestJSON-1498297445 None] Terminate volume connection completed successfully.
Sep 17 15:10:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-9702a1b7-9102-48f1-a9ff-782557f3ca8b req-12952432-c268-4709-9980-722b2ca2bee9 tempest-DeleteServersTestJSON-1498297445 None] Deleting attachment 76b48f34-4f1a-4c69-bf9c-23e90071f3a9. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:10:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Acquiring lock "cinder-1036bb2d-d746-49f8-bab5-9d853ea4d61c-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:10:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Lock "cinder-1036bb2d-d746-49f8-bab5-9d853ea4d61c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:10:57 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:10:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Acquiring lock "cinder-quobyte-1036bb2d-d746-49f8-bab5-9d853ea4d61c" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:10:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Lock "cinder-quobyte-1036bb2d-d746-49f8-bab5-9d853ea4d61c" acquired by "delete_volume" :: waited 0.029s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:10:57 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeba9ae-86a1-422b-8cd5-a229eca4a8a4]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:10:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c" returned: 0 in 0.598s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1036bb2d-d746-49f8-bab5-9d853ea4d61c" returned: 0 in 0.107s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Lock "cinder-quobyte-1036bb2d-d746-49f8-bab5-9d853ea4d61c" released by "delete_volume" :: held 0.955s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Created reservations ['e54d2e51-5746-40e9-ba15-938134ebbf91', '4fa1693e-1473-41c4-af7a-a3756112f143', 'e036886f-2368-46c7-8045-4680c1796337', 'a97de4af-b0c5-498a-8bf5-08241902b335'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.114s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:10:59 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Deleted volume successfully.
Sep 17 15:10:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c445c2d-eb96-4f0f-8a59-6ff473b85213 tempest-DeleteServersTestJSON-1498297445 None] Lock "cinder-1036bb2d-d746-49f8-bab5-9d853ea4d61c-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:11:09 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3,cinder:INSERT=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:11:09 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=9,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:11:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:11:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:11:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:11:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:11:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:11:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:11:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.365s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:11:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-bfbd2a2b-9b35-4a60-a6e0-a8adb8707193 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:11:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-bfbd2a2b-9b35-4a60-a6e0-a8adb8707193 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:11:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-bfbd2a2b-9b35-4a60-a6e0-a8adb8707193 tempest-TaggedBootDevicesTest-1243970107 None] Terminate volume connection completed successfully.
Sep 17 15:11:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-bfbd2a2b-9b35-4a60-a6e0-a8adb8707193 tempest-TaggedBootDevicesTest-1243970107 None] Deleting attachment 244f8850-1b0d-43f6-964d-62c3081d5adc. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:11:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-5db67ba7-6d89-44d4-9396-e01d1b8bc084 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:11:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-5db67ba7-6d89-44d4-9396-e01d1b8bc084 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:11:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-5db67ba7-6d89-44d4-9396-e01d1b8bc084 tempest-TaggedBootDevicesTest-1243970107 None] Terminate volume connection completed successfully.
Sep 17 15:11:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-5db67ba7-6d89-44d4-9396-e01d1b8bc084 tempest-TaggedBootDevicesTest-1243970107 None] Deleting attachment 4db0af6c-1503-4a27-a43b-45cf75c205db. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:11:40 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-de77e41d-46bc-4114-950a-68bf59547459 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:11:40 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-de77e41d-46bc-4114-950a-68bf59547459 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:11:40 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-de77e41d-46bc-4114-950a-68bf59547459 tempest-TaggedBootDevicesTest-1243970107 None] Terminate volume connection completed successfully.
Sep 17 15:11:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-3ca2c0c4-f23b-4176-8ffe-9cde6a0d2651 req-de77e41d-46bc-4114-950a-68bf59547459 tempest-TaggedBootDevicesTest-1243970107 None] Deleting attachment d73e76f4-d1ce-4128-9201-8a60f4905395. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:11:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "cinder-8fe1380c-943b-4f9f-a54d-57a25219ac5a-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:11:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-8fe1380c-943b-4f9f-a54d-57a25219ac5a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:11:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:11:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "cinder-quobyte-8fe1380c-943b-4f9f-a54d-57a25219ac5a" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:11:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-quobyte-8fe1380c-943b-4f9f-a54d-57a25219ac5a" acquired by "delete_volume" :: waited 0.015s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:11:49 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[81549f6d-0cbf-4b0b-b194-820e1d863e90]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:11:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a" returned: 0 in 0.515s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8fe1380c-943b-4f9f-a54d-57a25219ac5a" returned: 0 in 0.130s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-quobyte-8fe1380c-943b-4f9f-a54d-57a25219ac5a" released by "delete_volume" :: held 0.858s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Created reservations ['889b90cf-0ebb-4364-a7b9-bbf5c653a5f6', '2c849058-643b-46f1-b645-2918089bd7f4', 'd9b6ab9d-3c6c-4d83-a88c-322edbe65eac', '74f1fd57-ebb5-41f6-be9f-e2adf20b5d23'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.229s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:51 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:11:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Deleted volume successfully.
Sep 17 15:11:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a60c33bb-7fd6-4f4f-940e-2ea9b8971274 tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-8fe1380c-943b-4f9f-a54d-57a25219ac5a-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:11:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "cinder-2efed7d1-026b-413f-b1c3-d3931ee090a6-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:11:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-2efed7d1-026b-413f-b1c3-d3931ee090a6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:11:52 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:11:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "cinder-quobyte-2efed7d1-026b-413f-b1c3-d3931ee090a6" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:11:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-quobyte-2efed7d1-026b-413f-b1c3-d3931ee090a6" acquired by "delete_volume" :: waited 0.019s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:11:52 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[c227e75b-e85b-4232-b9cc-e1b25e206aa8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:11:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6" returned: 0 in 0.886s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2efed7d1-026b-413f-b1c3-d3931ee090a6" returned: 0 in 0.210s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-quobyte-2efed7d1-026b-413f-b1c3-d3931ee090a6" released by "delete_volume" :: held 1.475s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:11:54 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Created reservations ['ae9df76d-6192-438b-9f6a-976810c5a5f4', 'c51613f5-15bc-4775-9b17-62adaeb404a9', '0c6af50d-7b50-4482-8380-5df652665741', 'e3410657-fac8-45fe-8f7e-40b73995960b'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:11:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:11:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:11:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:11:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:11:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:11:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.258s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:55 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:11:55 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Deleted volume successfully.
Sep 17 15:11:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "cinder-52c2c831-e7c5-4ad5-833d-91240109c8f1-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:11:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e9c8af45-e456-4440-85f2-3de79f4953db tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-2efed7d1-026b-413f-b1c3-d3931ee090a6-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:11:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-52c2c831-e7c5-4ad5-833d-91240109c8f1-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:11:56 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:11:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "cinder-quobyte-52c2c831-e7c5-4ad5-833d-91240109c8f1" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:11:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-quobyte-52c2c831-e7c5-4ad5-833d-91240109c8f1" acquired by "delete_volume" :: waited 0.023s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:11:56 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0795dfe1-e6cf-438c-9afd-407c34daa25f]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:11:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1" returned: 0 in 0.701s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1" returned: 1 in 0.750s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:11:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-52c2c831-e7c5-4ad5-833d-91240109c8f1" returned: 0 in 0.210s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-quobyte-52c2c831-e7c5-4ad5-833d-91240109c8f1" released by "delete_volume" :: held 2.141s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:11:59 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Created reservations ['0aa8b9ab-8dea-46c4-a4e2-ce04f163c569', 'afeb6573-bf1a-4efb-bc9f-cd216a4d633a', 'a59ba18c-ffb4-4a1d-b97b-534d05cfe4f4', '9f3ad8a2-599f-4141-8ee6-8b974fe6a645'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:11:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:11:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:11:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:11:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:11:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:11:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:11:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.121s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:11:59 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:11:59 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Deleted volume successfully.
Sep 17 15:12:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-69fa7883-efd1-4838-a131-730ab9116f79 tempest-TaggedBootDevicesTest-1243970107 None] Lock "cinder-52c2c831-e7c5-4ad5-833d-91240109c8f1-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:12:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Flow 'volume_create_manager' (dc7f2131-e488-4824-bfea-e92c0818dbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18162037-66c0-443b-8d35-286d72c97b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18162037-66c0-443b-8d35-286d72c97b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-981455883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af1beec-2409-4f4c-b5e7-2b2c9eeea930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87f37cdc7304968b3871cdd3f5abd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:12:02Z,use_quota=True,user_id='2addad9cccee450ba4d7e586379a35a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba6c0bc-bdc4-460c-abce-abe660ea4958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba6c0bc-bdc4-460c-abce-abe660ea4958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64055fb-9157-42fb-b1a9-161868c4f36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64055fb-9157-42fb-b1a9-161868c4f36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af1beec-2409-4f4c-b5e7-2b2c9eeea930', 'volume_name': 'volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f7bf10-8c5b-40cf-a875-790876f6831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f7bf10-8c5b-40cf-a875-790876f6831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b52caa9-08aa-4163-a7de-4ecad2dd65e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:12:02 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Volume 9af1beec-2409-4f4c-b5e7-2b2c9eeea930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930', 'volume_size': 1}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-981455883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af1beec-2409-4f4c-b5e7-2b2c9eeea930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87f37cdc7304968b3871cdd3f5abd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:12:02Z,use_quota=True,user_id='2addad9cccee450ba4d7e586379a35a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Creating volume 9af1beec-2409-4f4c-b5e7-2b2c9eeea930 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:12:02 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:12:02 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=8, name=volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930 1073741824" returned: 0 in 0.433s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:12:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930" returned: 0 in 0.167s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:12:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] <== create_volume: return (682ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:12:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:12:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b52caa9-08aa-4163-a7de-4ecad2dd65e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:12:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e50c33-ac79-418e-897b-6973394acb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:12:03 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Volume volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930 (9af1beec-2409-4f4c-b5e7-2b2c9eeea930): created successfully
Sep 17 15:12:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e50c33-ac79-418e-897b-6973394acb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:12:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Flow 'volume_create_manager' (dc7f2131-e488-4824-bfea-e92c0818dbea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:12:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-71cdff19-594f-4fbd-aa92-0991ecdfbdc1 tempest-TaggedAttachmentsTest-943953864 None] Created volume successfully.
Sep 17 15:12:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:12:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:12:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:12:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:12:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:12:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:12:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:12:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.203s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:12:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:12:13 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=20,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=5 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:12:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=19,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:13:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:13:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:13:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:13:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:13:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:13:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:13:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:13:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.118s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:13:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:13:33 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Flow 'volume_create_manager' (7bf518a8-681b-4033-8a53-15e0ef51ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d12e42-c020-4311-a9a2-2296c5c64bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d12e42-c020-4311-a9a2-2296c5c64bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-451166261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d08e5c-2be5-47f1-bbfd-372a9b768c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde0e33c2b8d46f7b158c094cab110a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:13:33Z,use_quota=True,user_id='dc07856a02294fc9afb0ed8d122fd293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904177cd-aa37-4a54-93b9-3eedccc3dcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904177cd-aa37-4a54-93b9-3eedccc3dcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8077a670-75cf-417e-a3c0-e78e92035e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8077a670-75cf-417e-a3c0-e78e92035e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d08e5c-2be5-47f1-bbfd-372a9b768c37', 'volume_name': 'volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce42e94-3ba2-48a3-b05f-cf3ab2319cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce42e94-3ba2-48a3-b05f-cf3ab2319cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e76bffe-20a8-4f30-bfa1-49f631546c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:13:33 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Volume 24d08e5c-2be5-47f1-bbfd-372a9b768c37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37', 'volume_size': 1}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-451166261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d08e5c-2be5-47f1-bbfd-372a9b768c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde0e33c2b8d46f7b158c094cab110a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:13:33Z,use_quota=True,user_id='dc07856a02294fc9afb0ed8d122fd293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Creating volume 24d08e5c-2be5-47f1-bbfd-372a9b768c37 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:13:33 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:13:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:13:34 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=9, name=volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:13:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37 1073741824" returned: 0 in 0.691s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:13:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:13:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37" returned: 0 in 0.106s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:13:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] <== create_volume: return (932ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:13:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:13:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e76bffe-20a8-4f30-bfa1-49f631546c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:13:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39612e1b-37c1-450c-9ceb-dae7e952b991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:13:35 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Volume volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37 (24d08e5c-2be5-47f1-bbfd-372a9b768c37): created successfully
Sep 17 15:13:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39612e1b-37c1-450c-9ceb-dae7e952b991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:13:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Flow 'volume_create_manager' (7bf518a8-681b-4033-8a53-15e0ef51ede2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:13:35 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-22ca5ad0-0903-4278-ad2a-46e13e9bb09e tempest-AttachSCSIVolumeTestJSON-772977025 None] Created volume successfully.
Sep 17 15:13:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-857c8ab6-3244-4784-97a2-a12ab2af8df1 req-c4029c36-e7de-44ae-af98-e68f5b8dce0e tempest-AttachSCSIVolumeTestJSON-772977025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:13:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-857c8ab6-3244-4784-97a2-a12ab2af8df1 req-c4029c36-e7de-44ae-af98-e68f5b8dce0e tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:13:40 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5ea305-c6e4-4f36-8743-c1c829b3815d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:13:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-857c8ab6-3244-4784-97a2-a12ab2af8df1 req-c4029c36-e7de-44ae-af98-e68f5b8dce0e tempest-AttachSCSIVolumeTestJSON-772977025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:13:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-857c8ab6-3244-4784-97a2-a12ab2af8df1 req-c4029c36-e7de-44ae-af98-e68f5b8dce0e tempest-AttachSCSIVolumeTestJSON-772977025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37" returned: 0 in 0.538s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:13:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-857c8ab6-3244-4784-97a2-a12ab2af8df1 req-c4029c36-e7de-44ae-af98-e68f5b8dce0e tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.659s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:13:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-857c8ab6-3244-4784-97a2-a12ab2af8df1 req-c4029c36-e7de-44ae-af98-e68f5b8dce0e tempest-AttachSCSIVolumeTestJSON-772977025 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf663ccb-a817-4394-9404-00bef1346d27', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:13:41 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-857c8ab6-3244-4784-97a2-a12ab2af8df1 req-c4029c36-e7de-44ae-af98-e68f5b8dce0e tempest-AttachSCSIVolumeTestJSON-772977025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:13:41 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-857c8ab6-3244-4784-97a2-a12ab2af8df1 req-c4029c36-e7de-44ae-af98-e68f5b8dce0e tempest-AttachSCSIVolumeTestJSON-772977025 None] attachment_update completed successfully.
Sep 17 15:13:51 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:13:51 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:14:10 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-1e80d5d1-5bdf-400c-8279-1b08a95bc2c8 req-a211b2cd-ea92-4139-8028-5a78bc753e51 tempest-AttachSCSIVolumeTestJSON-772977025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:14:10 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-1e80d5d1-5bdf-400c-8279-1b08a95bc2c8 req-a211b2cd-ea92-4139-8028-5a78bc753e51 tempest-AttachSCSIVolumeTestJSON-772977025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:14:10 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-1e80d5d1-5bdf-400c-8279-1b08a95bc2c8 req-a211b2cd-ea92-4139-8028-5a78bc753e51 tempest-AttachSCSIVolumeTestJSON-772977025 None] Terminate volume connection completed successfully.
Sep 17 15:14:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-1e80d5d1-5bdf-400c-8279-1b08a95bc2c8 req-a211b2cd-ea92-4139-8028-5a78bc753e51 tempest-AttachSCSIVolumeTestJSON-772977025 None] Deleting attachment bf663ccb-a817-4394-9404-00bef1346d27. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:14:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:14:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:14:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:14:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:14:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:14:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:14:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:14:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.347s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:14:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:14:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-1e36f880-10af-45c5-a767-263d158d52c2 req-12d4fbd4-1969-4414-b938-b3a9b0c2f671 tempest-TaggedAttachmentsTest-943953864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:14:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-1e36f880-10af-45c5-a767-263d158d52c2 req-12d4fbd4-1969-4414-b938-b3a9b0c2f671 tempest-TaggedAttachmentsTest-943953864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:14:12 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24253a1-9f4f-4e38-b1f1-f698052100dd]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:14:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-1e36f880-10af-45c5-a767-263d158d52c2 req-12d4fbd4-1969-4414-b938-b3a9b0c2f671 tempest-TaggedAttachmentsTest-943953864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:14:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-1e36f880-10af-45c5-a767-263d158d52c2 req-12d4fbd4-1969-4414-b938-b3a9b0c2f671 tempest-TaggedAttachmentsTest-943953864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930" returned: 0 in 0.798s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:14:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-1e36f880-10af-45c5-a767-263d158d52c2 req-12d4fbd4-1969-4414-b938-b3a9b0c2f671 tempest-TaggedAttachmentsTest-943953864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.993s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:14:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-1e36f880-10af-45c5-a767-263d158d52c2 req-12d4fbd4-1969-4414-b938-b3a9b0c2f671 tempest-TaggedAttachmentsTest-943953864 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15f32551-f5d7-495d-a39c-d9d27c2d3ccb', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:14:15 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-1e36f880-10af-45c5-a767-263d158d52c2 req-12d4fbd4-1969-4414-b938-b3a9b0c2f671 tempest-TaggedAttachmentsTest-943953864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:14:15 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-1e36f880-10af-45c5-a767-263d158d52c2 req-12d4fbd4-1969-4414-b938-b3a9b0c2f671 tempest-TaggedAttachmentsTest-943953864 None] attachment_update completed successfully.
Sep 17 15:14:25 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:14:25 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:14:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Acquiring lock "cinder-24d08e5c-2be5-47f1-bbfd-372a9b768c37-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:14:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "cinder-24d08e5c-2be5-47f1-bbfd-372a9b768c37-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:14:26 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:14:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Acquiring lock "cinder-quobyte-24d08e5c-2be5-47f1-bbfd-372a9b768c37" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:14:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "cinder-quobyte-24d08e5c-2be5-47f1-bbfd-372a9b768c37" acquired by "delete_volume" :: waited 0.009s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:14:26 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd9d72d-be14-471e-b7e7-d86ee996564e]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:14:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:14:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37" returned: 0 in 0.403s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:14:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-24d08e5c-2be5-47f1-bbfd-372a9b768c37" returned: 0 in 0.115s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "cinder-quobyte-24d08e5c-2be5-47f1-bbfd-372a9b768c37" released by "delete_volume" :: held 0.657s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Created reservations ['66083296-8f20-4572-847a-e3e13e871e16', 'c46ee940-2be6-42e8-ab03-acd198ace142', 'f65d3fab-67a7-4981-a933-62f33c23feff', '8d1a5bc1-3c28-4be9-a19b-fccce17b8e16'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.125s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:14:27 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:14:27 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Deleted volume successfully.
Sep 17 15:14:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2b841d84-6768-4a4e-a306-4b3aabcbb9b8 tempest-AttachSCSIVolumeTestJSON-772977025 None] Lock "cinder-24d08e5c-2be5-47f1-bbfd-372a9b768c37-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:14:32 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Flow 'volume_create_manager' (086a91a5-9fe8-4a3b-b494-0c930020e77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8df2e-ea33-47b3-a5c5-a5accbcbcbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8df2e-ea33-47b3-a5c5-a5accbcbcbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1538406761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4e8e21-bb5a-4720-af04-b796f55fe6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c6111c2cd043788666933a365dce41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:14:32Z,use_quota=True,user_id='93462c229f8f491ab00052074e0a10c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9033cedb-869f-4658-a637-8a468eefcd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9033cedb-869f-4658-a637-8a468eefcd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15be85ec-b403-428d-b65c-e4dea913b89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15be85ec-b403-428d-b65c-e4dea913b89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4e8e21-bb5a-4720-af04-b796f55fe6b1', 'volume_name': 'volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0987d227-60b7-4d68-a22b-790b5a333117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0987d227-60b7-4d68-a22b-790b5a333117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e382415-5ad5-4c26-a326-5f2b3ceb82a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:14:32 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume 7b4e8e21-bb5a-4720-af04-b796f55fe6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1', 'volume_size': 1}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1538406761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4e8e21-bb5a-4720-af04-b796f55fe6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c6111c2cd043788666933a365dce41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:14:32Z,use_quota=True,user_id='93462c229f8f491ab00052074e0a10c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Creating volume 7b4e8e21-bb5a-4720-af04-b796f55fe6b1 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:14:32 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:14:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:14:33 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=10, name=volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:14:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1 1073741824" returned: 0 in 0.583s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:14:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:14:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1" returned: 0 in 0.152s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:14:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] <== create_volume: return (829ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:14:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:14:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e382415-5ad5-4c26-a326-5f2b3ceb82a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:14:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da165ee-2241-4699-9278-d2b871f1f98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:14:33 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1 (7b4e8e21-bb5a-4720-af04-b796f55fe6b1): created successfully
Sep 17 15:14:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da165ee-2241-4699-9278-d2b871f1f98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:14:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Flow 'volume_create_manager' (086a91a5-9fe8-4a3b-b494-0c930020e77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:14:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-48271f07-d6b2-4509-9300-3e8a005600e8 tempest-AttachVolumeShelveTestJSON-1007162739 None] Created volume successfully.
Sep 17 15:14:43 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:14:44 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=11,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:14:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3711bfdd-4d87-42a0-a085-2cb2c165426e req-d7cad5a9-3750-445f-82f9-31823ef68fe7 tempest-TaggedAttachmentsTest-943953864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:14:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3711bfdd-4d87-42a0-a085-2cb2c165426e req-d7cad5a9-3750-445f-82f9-31823ef68fe7 tempest-TaggedAttachmentsTest-943953864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:14:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-3711bfdd-4d87-42a0-a085-2cb2c165426e req-d7cad5a9-3750-445f-82f9-31823ef68fe7 tempest-TaggedAttachmentsTest-943953864 None] Terminate volume connection completed successfully.
Sep 17 15:14:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-3711bfdd-4d87-42a0-a085-2cb2c165426e req-d7cad5a9-3750-445f-82f9-31823ef68fe7 tempest-TaggedAttachmentsTest-943953864 None] Deleting attachment 15f32551-f5d7-495d-a39c-d9d27c2d3ccb. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:14:56 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:15:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-47f6374e-4e6f-490d-a1e4-bc70893c8f21 req-5b21246e-b36e-49b7-a92f-61d721091862 tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:15:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-47f6374e-4e6f-490d-a1e4-bc70893c8f21 req-5b21246e-b36e-49b7-a92f-61d721091862 tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:15:02 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2769c8b6-e510-47fd-8c75-5473bcd23e96]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:15:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-47f6374e-4e6f-490d-a1e4-bc70893c8f21 req-5b21246e-b36e-49b7-a92f-61d721091862 tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:15:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-47f6374e-4e6f-490d-a1e4-bc70893c8f21 req-5b21246e-b36e-49b7-a92f-61d721091862 tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1" returned: 0 in 0.538s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:15:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-47f6374e-4e6f-490d-a1e4-bc70893c8f21 req-5b21246e-b36e-49b7-a92f-61d721091862 tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.615s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:15:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-47f6374e-4e6f-490d-a1e4-bc70893c8f21 req-5b21246e-b36e-49b7-a92f-61d721091862 tempest-AttachVolumeShelveTestJSON-1007162739 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a7b40ce-817a-4157-81c0-dbb5b6694d5d', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:15:03 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-47f6374e-4e6f-490d-a1e4-bc70893c8f21 req-5b21246e-b36e-49b7-a92f-61d721091862 tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:15:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-47f6374e-4e6f-490d-a1e4-bc70893c8f21 req-5b21246e-b36e-49b7-a92f-61d721091862 tempest-AttachVolumeShelveTestJSON-1007162739 None] attachment_update completed successfully.
Sep 17 15:15:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:15:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:15:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:15:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:15:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:15:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:15:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:15:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.152s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:15:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:15:13 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:15:13 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:15:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Acquiring lock "cinder-9af1beec-2409-4f4c-b5e7-2b2c9eeea930-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:15:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Lock "cinder-9af1beec-2409-4f4c-b5e7-2b2c9eeea930-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:15:58 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:15:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Acquiring lock "cinder-quobyte-9af1beec-2409-4f4c-b5e7-2b2c9eeea930" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:15:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Lock "cinder-quobyte-9af1beec-2409-4f4c-b5e7-2b2c9eeea930" acquired by "delete_volume" :: waited 0.031s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:15:58 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c9cc74-aa7d-49f1-9233-5cbb11e3bc4d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:15:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:15:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930" returned: 0 in 0.978s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:15:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:15:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9af1beec-2409-4f4c-b5e7-2b2c9eeea930" returned: 0 in 0.109s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:15:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Lock "cinder-quobyte-9af1beec-2409-4f4c-b5e7-2b2c9eeea930" released by "delete_volume" :: held 1.339s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:15:59 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Created reservations ['35b9457a-fe3c-4600-bf24-27285c4be08d', 'ba9b3cdd-959b-4596-9542-dfb594bfd5f8', '450dcd81-b65f-4d19-8673-e3b400781c86', 'b407aa02-ee63-4ddf-a4ce-81d529c014eb'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:16:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:16:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:16:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:16:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:16:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.074s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:16:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.443s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:01 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:16:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Deleted volume successfully.
Sep 17 15:16:01 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7bda70a-fa4a-4e16-8afd-60b09bcf5c5e tempest-TaggedAttachmentsTest-943953864 None] Lock "cinder-9af1beec-2409-4f4c-b5e7-2b2c9eeea930-delete_volume" released by "delete_volume" :: held 4.338s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:16:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:16:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:16:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:16:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:16:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:16:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:16:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:12 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:16:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.572s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:16:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6,cinder:INSERT=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:16:35 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:16:35 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Flow 'volume_create_manager' (850588fd-1feb-4ce8-b601-db15914f273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634e783c-4e97-442a-8371-29e2930fbf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634e783c-4e97-442a-8371-29e2930fbf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-118598601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6319b37-0079-4845-849c-54d761644eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a5f638964442cb421f01915cc7b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:16:35Z,use_quota=True,user_id='359ab79968ef47a2a8b9633cf07c6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e977e195-0d70-4dde-a5a8-33c00e19291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e977e195-0d70-4dde-a5a8-33c00e19291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c40fa8-2721-4314-b1a3-4b5ac8e742d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c40fa8-2721-4314-b1a3-4b5ac8e742d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6319b37-0079-4845-849c-54d761644eb7', 'volume_name': 'volume-d6319b37-0079-4845-849c-54d761644eb7', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f05b4a-26c1-4a2f-a93f-d535dfcb4461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f05b4a-26c1-4a2f-a93f-d535dfcb4461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4980215e-97bc-4ad3-8332-f4fbfa1aedb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:36 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Volume d6319b37-0079-4845-849c-54d761644eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6319b37-0079-4845-849c-54d761644eb7', 'volume_size': 1}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-118598601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6319b37-0079-4845-849c-54d761644eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a5f638964442cb421f01915cc7b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:16:35Z,use_quota=True,user_id='359ab79968ef47a2a8b9633cf07c6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Creating volume d6319b37-0079-4845-849c-54d761644eb7 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:16:36 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:16:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d6319b37-0079-4845-849c-54d761644eb7 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:36 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=11, name=volume-d6319b37-0079-4845-849c-54d761644eb7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:16:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d6319b37-0079-4845-849c-54d761644eb7 1073741824" returned: 0 in 0.607s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d6319b37-0079-4845-849c-54d761644eb7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d6319b37-0079-4845-849c-54d761644eb7" returned: 0 in 0.523s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] <== create_volume: return (1295ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:16:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:16:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4980215e-97bc-4ad3-8332-f4fbfa1aedb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6319b37-0079-4845-849c-54d761644eb7', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3dea27-2c5f-4cf7-9e81-e090691d2a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:38 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Volume volume-d6319b37-0079-4845-849c-54d761644eb7 (d6319b37-0079-4845-849c-54d761644eb7): created successfully
Sep 17 15:16:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3dea27-2c5f-4cf7-9e81-e090691d2a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Flow 'volume_create_manager' (850588fd-1feb-4ce8-b601-db15914f273c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:16:38 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-dee79762-cec0-43b6-b76e-513e1d40803a tempest-ServersNegativeTestJSON-1281099061 None] Created volume successfully.
Sep 17 15:16:41 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Flow 'volume_create_manager' (d5ef3920-2f7a-4491-9f31-fd09ded388ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e426138c-94b3-45b4-be2f-84e7973fc0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e426138c-94b3-45b4-be2f-84e7973fc0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-545515462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74b35a8-3dca-425b-b469-e5b0e2f8418e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a5f638964442cb421f01915cc7b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:16:41Z,use_quota=True,user_id='359ab79968ef47a2a8b9633cf07c6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9428545e-f5a0-468c-893b-3107aee92882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9428545e-f5a0-468c-893b-3107aee92882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbc9f90-8fa3-40b8-9dce-56ebe296820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbc9f90-8fa3-40b8-9dce-56ebe296820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74b35a8-3dca-425b-b469-e5b0e2f8418e', 'volume_name': 'volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9986f450-820b-46d0-80d2-f2ae59b01513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9986f450-820b-46d0-80d2-f2ae59b01513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b81645-b34c-43f9-a25d-e28c2844eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:41 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Volume e74b35a8-3dca-425b-b469-e5b0e2f8418e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e', 'volume_size': 1}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-545515462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74b35a8-3dca-425b-b469-e5b0e2f8418e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a5f638964442cb421f01915cc7b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:16:41Z,use_quota=True,user_id='359ab79968ef47a2a8b9633cf07c6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Creating volume e74b35a8-3dca-425b-b469-e5b0e2f8418e {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:16:41 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:16:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:41 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=12, name=volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:16:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e 1073741824" returned: 0 in 0.487s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e" returned: 0 in 0.214s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:42 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] <== create_volume: return (766ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:16:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:16:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b81645-b34c-43f9-a25d-e28c2844eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ac7413-3a3a-4675-a8db-a88548a6968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:16:42 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Volume volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e (e74b35a8-3dca-425b-b469-e5b0e2f8418e): created successfully
Sep 17 15:16:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ac7413-3a3a-4675-a8db-a88548a6968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:16:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Flow 'volume_create_manager' (d5ef3920-2f7a-4491-9f31-fd09ded388ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:16:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-686ebf45-ef28-42b5-944a-8d2fb0d70605 tempest-ServersNegativeTestJSON-1281099061 None] Created volume successfully.
Sep 17 15:16:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "cinder-e74b35a8-3dca-425b-b469-e5b0e2f8418e-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:16:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Lock "cinder-e74b35a8-3dca-425b-b469-e5b0e2f8418e-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:16:44 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:16:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "cinder-quobyte-e74b35a8-3dca-425b-b469-e5b0e2f8418e" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:16:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Lock "cinder-quobyte-e74b35a8-3dca-425b-b469-e5b0e2f8418e" acquired by "delete_volume" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:16:44 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebfc4e4-ccf3-4531-a45c-67f50daf448a]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:16:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e" returned: 0 in 0.661s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e74b35a8-3dca-425b-b469-e5b0e2f8418e" returned: 0 in 0.212s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Lock "cinder-quobyte-e74b35a8-3dca-425b-b469-e5b0e2f8418e" released by "delete_volume" :: held 1.105s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:16:45 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Created reservations ['3d99bbcc-99c5-4537-9038-6421e1627969', 'b286e86c-fca2-448f-9ef4-ae8f8b79b015', 'dd183653-e63b-4ab2-bf92-fc3db9824d66', 'a1f2fe9b-ceb7-4865-ab34-f0128b53b288'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:16:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:16:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:16:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:16:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:16:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:16:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.221s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:46 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:16:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Deleted volume successfully.
Sep 17 15:16:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "cinder-d6319b37-0079-4845-849c-54d761644eb7-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:16:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Lock "cinder-d6319b37-0079-4845-849c-54d761644eb7-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:16:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c643d2b0-9d55-4217-99f1-93aa20055f3b tempest-ServersNegativeTestJSON-1281099061 None] Lock "cinder-e74b35a8-3dca-425b-b469-e5b0e2f8418e-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:16:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:16:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "cinder-quobyte-d6319b37-0079-4845-849c-54d761644eb7" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:16:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Lock "cinder-quobyte-d6319b37-0079-4845-849c-54d761644eb7" acquired by "delete_volume" :: waited 0.028s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:16:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3822a0b7-81fe-4def-8143-d7324c35de26]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:16:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d6319b37-0079-4845-849c-54d761644eb7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:48 devstack quobyte-client[83236]: System call of process 88751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:16:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d6319b37-0079-4845-849c-54d761644eb7" returned: 0 in 0.968s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d6319b37-0079-4845-849c-54d761644eb7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d6319b37-0079-4845-849c-54d761644eb7" returned: 0 in 0.222s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Lock "cinder-quobyte-d6319b37-0079-4845-849c-54d761644eb7" released by "delete_volume" :: held 1.635s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:16:49 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Created reservations ['57966020-f8a6-4bb3-a69c-37aa0903d029', '40d45c71-549e-40bb-acd4-7da05ab66d98', '54f6e079-35e2-4597-9d58-8af57f1f0779', 'b9025bff-be61-47e8-a91e-d5b4000420d9'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:16:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:16:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:16:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:16:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:16:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:16:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:16:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.287s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:16:50 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:16:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Deleted volume successfully.
Sep 17 15:16:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-929e091d-a876-4058-a7b7-880012c0d9c5 tempest-ServersNegativeTestJSON-1281099061 None] Lock "cinder-d6319b37-0079-4845-849c-54d761644eb7-delete_volume" released by "delete_volume" :: held 5.314s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:16:59 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=16,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:17:02 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=18,cinder:SELECT=8,cinder:INSERT=8,cinder:DELETE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:17:11 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Flow 'volume_create_manager' (2d8a8152-b319-494f-8220-0989d36c5846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8ec56d-4103-44c2-b250-90b354d9225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8ec56d-4103-44c2-b250-90b354d9225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-815257105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e8a10f-bf65-4a7d-889a-5801d7e3e221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77eb9fb0bb3425ba7072ed4c71337ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:11Z,use_quota=True,user_id='571701e3178f42b9845d9a1920ed50fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdcb12c-ad3c-4063-900c-60d01b55002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdcb12c-ad3c-4063-900c-60d01b55002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8829fa-884b-45ef-ab13-9f53bf18d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8829fa-884b-45ef-ab13-9f53bf18d078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93e8a10f-bf65-4a7d-889a-5801d7e3e221', 'volume_name': 'volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ea7cf0-53a1-4536-b013-c0d22b5ac988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ea7cf0-53a1-4536-b013-c0d22b5ac988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e958aac2-738a-4a2f-b6aa-856f167e2768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:11 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Volume 93e8a10f-bf65-4a7d-889a-5801d7e3e221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221', 'volume_size': 1}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-815257105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e8a10f-bf65-4a7d-889a-5801d7e3e221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77eb9fb0bb3425ba7072ed4c71337ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:11Z,use_quota=True,user_id='571701e3178f42b9845d9a1920ed50fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Creating volume 93e8a10f-bf65-4a7d-889a-5801d7e3e221 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:17:11 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:11 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=13, name=volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 1073741824" returned: 0 in 0.406s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221" returned: 0 in 0.110s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.248s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] <== create_volume: return (593ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.604s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e958aac2-738a-4a2f-b6aa-856f167e2768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea054b6-7742-4080-a2a4-ef6e492d76a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:12 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Volume volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 (93e8a10f-bf65-4a7d-889a-5801d7e3e221): created successfully
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea054b6-7742-4080-a2a4-ef6e492d76a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Flow 'volume_create_manager' (2d8a8152-b319-494f-8220-0989d36c5846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:12 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-e12a7a6a-488d-4615-89fa-b8a513ff16e2 req-2ee9ca47-4f4d-40f7-9b8b-2ec889b90f85 tempest-VolumesSnapshotsTestJSON-1327630725 None] Created volume successfully.
Sep 17 15:17:13 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Creating offline snapshot 7b8ca397-2e24-46e0-bada-760c18c68a89 of volume 93e8a10f-bf65-4a7d-889a-5801d7e3e221 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:17:13 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[23275f50-6770-4077-97b7-9372658e3bf6]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:17:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221" returned: 0 in 0.463s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:14 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=14, name=volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:17:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 1G" returned: 0 in 0.230s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): qemu-img rebase -u -b volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "qemu-img rebase -u -b volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89" returned: 0 in 0.129s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:14 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:17:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89" returned: 0 in 0.135s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89" returned: 0 in 0.095s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.info" returned: 0 in 0.086s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.info" returned: 0 in 0.076s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.538s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:15 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-52a440f5-e8c5-4d64-a40e-8c9277454bc0 req-6bca44f8-e94a-4b5d-bb28-7b72a0350158 tempest-VolumesSnapshotsTestJSON-1327630725 None] Create snapshot completed successfully
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Acquiring lock "cinder-7b8ca397-2e24-46e0-bada-760c18c68a89-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-7b8ca397-2e24-46e0-bada-760c18c68a89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:16 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Acquiring lock "cinder-quobyte-93e8a10f-bf65-4a7d-889a-5801d7e3e221" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-quobyte-93e8a10f-bf65-4a7d-889a-5801d7e3e221" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Acquiring lock "cinder-quobyte-7b8ca397-2e24-46e0-bada-760c18c68a89" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-quobyte-7b8ca397-2e24-46e0-bada-760c18c68a89" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Deleting offline snapshot 7b8ca397-2e24-46e0-bada-760c18c68a89 of volume 93e8a10f-bf65-4a7d-889a-5801d7e3e221 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] snapshot_file for this snap is: volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaefbd9-88e7-4fb8-9d80-e9ddcd239bb6]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89" returned: 0 in 0.438s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0791f5ac-fabc-46fb-8999-42345f2c2e92]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:17:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221" returned: 0 in 0.559s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89" returned: 0 in 0.244s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221.7b8ca397-2e24-46e0-bada-760c18c68a89" returned: 0 in 0.095s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-quobyte-7b8ca397-2e24-46e0-bada-760c18c68a89" released by "_delete_snapshot" :: held 1.627s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-quobyte-93e8a10f-bf65-4a7d-889a-5801d7e3e221" released by "delete_snapshot" :: held 1.649s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:18 devstack cinder-volume[83214]: WARNING cinder.quota [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:17:18 devstack cinder-volume[83214]: DEBUG cinder.quota [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Created reservations ['93154668-06d8-4c09-83a3-5f2d4fdf3071', '2f0e3fc3-cd1a-4482-b378-688115d35713', '685f0334-ef1a-46a4-b46f-faed1391aed4', 'bf3bb7df-fecc-4f85-a2ae-6e0e78fe2604'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:17:18 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Delete snapshot completed successfully.
Sep 17 15:17:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-5a78b6f8-9d78-487f-b16d-7a08b1883923 req-e6a70204-1169-4b5c-80c7-4ce1bfd25581 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-7b8ca397-2e24-46e0-bada-760c18c68a89-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Acquiring lock "cinder-93e8a10f-bf65-4a7d-889a-5801d7e3e221-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-93e8a10f-bf65-4a7d-889a-5801d7e3e221-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:19 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Acquiring lock "cinder-quobyte-93e8a10f-bf65-4a7d-889a-5801d7e3e221" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-quobyte-93e8a10f-bf65-4a7d-889a-5801d7e3e221" acquired by "delete_volume" :: waited 0.026s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:19 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d0d55d-1ea5-4c2e-96b3-ff1cafe7abb8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:17:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:20 devstack quobyte-client[83236]: System call of process 88951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:17:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221" returned: 0 in 1.224s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-93e8a10f-bf65-4a7d-889a-5801d7e3e221" returned: 0 in 0.161s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-quobyte-93e8a10f-bf65-4a7d-889a-5801d7e3e221" released by "delete_volume" :: held 1.667s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:21 devstack cinder-volume[83214]: DEBUG cinder.quota [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Created reservations ['3137a1e5-3a02-40b2-983e-8914611e42f8', 'f4947aa3-5741-4b64-938d-ab00d245f15a', '43dbad99-7cd3-49a1-9938-8fa02f2172ad', 'b8feb125-199f-486d-93c5-1897a23eaaaf'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:17:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.196s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:21 devstack cinder-volume[83214]: DEBUG cinder.manager [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:17:21 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Deleted volume successfully.
Sep 17 15:17:22 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-6ef6e939-71b9-496b-b808-42a7c4d080c9 req-045cef0e-7dfc-44d5-b340-5fa0cb27e5d5 tempest-VolumesSnapshotsTestJSON-1327630725 None] Lock "cinder-93e8a10f-bf65-4a7d-889a-5801d7e3e221-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:25 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Flow 'volume_create_manager' (63e7add1-dd85-4a85-82f0-fe62865ef655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fd595f-4081-4a33-b2c1-9b71fe7d53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fd595f-4081-4a33-b2c1-9b71fe7d53d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1304153376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4782dd9d-3495-43fd-b6be-7dbeadffe26a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5a3252d9a5048dfb088bb9128a357bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:25Z,use_quota=True,user_id='d3baf4d51ab941b4adacf9434b3c8253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f07cedd-6ede-4797-a154-3488003d2d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f07cedd-6ede-4797-a154-3488003d2d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b46fe6d-e09c-4b3f-b000-3e7fca484b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b46fe6d-e09c-4b3f-b000-3e7fca484b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4782dd9d-3495-43fd-b6be-7dbeadffe26a', 'volume_name': 'volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b641753-13eb-4293-9ddd-5bad67e7d9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b641753-13eb-4293-9ddd-5bad67e7d9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe153bd4-111e-409f-baa7-844bc7325afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Volume 4782dd9d-3495-43fd-b6be-7dbeadffe26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a', 'volume_size': 1}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1304153376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4782dd9d-3495-43fd-b6be-7dbeadffe26a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5a3252d9a5048dfb088bb9128a357bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:25Z,use_quota=True,user_id='d3baf4d51ab941b4adacf9434b3c8253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Creating volume 4782dd9d-3495-43fd-b6be-7dbeadffe26a {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:17:25 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:17:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:25 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=16, name=volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:17:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a 1073741824" returned: 0 in 0.318s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a" returned: 0 in 0.188s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] <== create_volume: return (600ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:17:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.613s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe153bd4-111e-409f-baa7-844bc7325afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5cf2d2-7b7c-4384-82c1-7e24c801e9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:26 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Volume volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a (4782dd9d-3495-43fd-b6be-7dbeadffe26a): created successfully
Sep 17 15:17:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5cf2d2-7b7c-4384-82c1-7e24c801e9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Flow 'volume_create_manager' (63e7add1-dd85-4a85-82f0-fe62865ef655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-0d62d7a9-027a-4352-abff-d100fa24bfec req-902ca4f9-f3f7-4aa2-9789-9628bfbadfd1 tempest-VolumesGetTestJSON-2052460589 None] Created volume successfully.
Sep 17 15:17:27 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-d2e19e35-a13e-4e57-9c32-044e24b48a53 req-1b4669ae-c951-4f03-90bc-80beada0a2b0 tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-d2e19e35-a13e-4e57-9c32-044e24b48a53 req-1b4669ae-c951-4f03-90bc-80beada0a2b0 tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:28 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-d2e19e35-a13e-4e57-9c32-044e24b48a53 req-1b4669ae-c951-4f03-90bc-80beada0a2b0 tempest-AttachVolumeShelveTestJSON-1007162739 None] Terminate volume connection completed successfully.
Sep 17 15:17:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-d2e19e35-a13e-4e57-9c32-044e24b48a53 req-1b4669ae-c951-4f03-90bc-80beada0a2b0 tempest-AttachVolumeShelveTestJSON-1007162739 None] Deleting attachment 6a7b40ce-817a-4157-81c0-dbb5b6694d5d. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:17:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Acquiring lock "cinder-4782dd9d-3495-43fd-b6be-7dbeadffe26a-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Lock "cinder-4782dd9d-3495-43fd-b6be-7dbeadffe26a-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Acquiring lock "cinder-quobyte-4782dd9d-3495-43fd-b6be-7dbeadffe26a" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Lock "cinder-quobyte-4782dd9d-3495-43fd-b6be-7dbeadffe26a" acquired by "delete_volume" :: waited 0.023s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:28 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eb7da6-42aa-4138-a4c0-26fabff4b9f9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:17:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a" returned: 0 in 0.728s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4782dd9d-3495-43fd-b6be-7dbeadffe26a" returned: 0 in 0.505s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Lock "cinder-quobyte-4782dd9d-3495-43fd-b6be-7dbeadffe26a" released by "delete_volume" :: held 1.779s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:31 devstack cinder-volume[83214]: DEBUG cinder.quota [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Created reservations ['ef9c4272-14e3-473a-a2f4-f51897569cb9', '5f79a15f-1fb4-40fa-8f41-bfad2589958a', '946e4af3-f41a-4197-8c03-5ee3ee6c3672', '3581c90e-4a10-4414-b9d7-8ab45b8a207f'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:17:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.186s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:31 devstack cinder-volume[83214]: DEBUG cinder.manager [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:17:32 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Deleted volume successfully.
Sep 17 15:17:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-1669d2cd-78fa-4bac-8478-02aab52eb987 req-7f75e78c-ecae-49c0-9f52-78510e563bdc tempest-VolumesGetTestJSON-2052460589 None] Lock "cinder-4782dd9d-3495-43fd-b6be-7dbeadffe26a-delete_volume" released by "delete_volume" :: held 4.104s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:40 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Flow 'volume_create_manager' (14fc4bed-ed7d-4f1f-810a-c81ac262940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18cd746-6e2b-471c-a250-5fa599fb801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18cd746-6e2b-471c-a250-5fa599fb801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1440455988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83497bf-bb94-4e5b-90f5-26cbb86e4f44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35dc2a2f43f94feda56265a4d6e2aed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:40Z,use_quota=True,user_id='7daafaf50ff543ccab449a13c2ce0785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5326cf7-134d-4432-af36-65d1a68065b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5326cf7-134d-4432-af36-65d1a68065b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f82bbb-411f-4813-b8ea-cc9c4df75abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f82bbb-411f-4813-b8ea-cc9c4df75abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83497bf-bb94-4e5b-90f5-26cbb86e4f44', 'volume_name': 'volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90addc2-3489-4a6e-be82-3d54c92e0fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90addc2-3489-4a6e-be82-3d54c92e0fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68b6708-8792-46ea-88ea-2c2df9c92bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:40 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Volume f83497bf-bb94-4e5b-90f5-26cbb86e4f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44', 'volume_size': 1}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1440455988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83497bf-bb94-4e5b-90f5-26cbb86e4f44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35dc2a2f43f94feda56265a4d6e2aed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:40Z,use_quota=True,user_id='7daafaf50ff543ccab449a13c2ce0785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Creating volume f83497bf-bb94-4e5b-90f5-26cbb86e4f44 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:17:40 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:17:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:40 devstack quobyte-client[83236]: System call of process 89064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:17:40 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=17, name=volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:17:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44 1073741824" returned: 0 in 0.482s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44" returned: 0 in 0.182s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] <== create_volume: return (753ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:17:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68b6708-8792-46ea-88ea-2c2df9c92bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c94f844-4c78-449b-9f65-27bbe174aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:41 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Volume volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44 (f83497bf-bb94-4e5b-90f5-26cbb86e4f44): created successfully
Sep 17 15:17:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c94f844-4c78-449b-9f65-27bbe174aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Flow 'volume_create_manager' (14fc4bed-ed7d-4f1f-810a-c81ac262940a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:41 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9568982f-659c-4f0e-beb4-98f890597115 tempest-VolumesTestJSON-1994590420 None] Created volume successfully.
Sep 17 15:17:43 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Flow 'volume_create_manager' (eacd00e7-2ae0-45f2-8264-466a1ca34587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06334bc3-ed85-4c52-b24e-3fba1ecdb12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06334bc3-ed85-4c52-b24e-3fba1ecdb12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-691874849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b970b570-a36b-4368-b7ad-f2e29d3ff8b0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35dc2a2f43f94feda56265a4d6e2aed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:43Z,use_quota=True,user_id='7daafaf50ff543ccab449a13c2ce0785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b455c319-c0fd-42f9-a6c2-e6ae8a802486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b455c319-c0fd-42f9-a6c2-e6ae8a802486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0506c72e-a4a9-430a-b051-1a891a87c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0506c72e-a4a9-430a-b051-1a891a87c177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b970b570-a36b-4368-b7ad-f2e29d3ff8b0', 'volume_name': 'volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a98ade-8890-4b46-bfd3-7983c78fe108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a98ade-8890-4b46-bfd3-7983c78fe108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a52c490-e46c-48a5-8dc8-b91872bfc71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:43 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Volume b970b570-a36b-4368-b7ad-f2e29d3ff8b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0', 'volume_size': 1}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-691874849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b970b570-a36b-4368-b7ad-f2e29d3ff8b0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35dc2a2f43f94feda56265a4d6e2aed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:43Z,use_quota=True,user_id='7daafaf50ff543ccab449a13c2ce0785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Creating volume b970b570-a36b-4368-b7ad-f2e29d3ff8b0 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:17:43 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:43 devstack quobyte-client[83236]: System call of process 89070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:17:43 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=18, name=volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0 1073741824" returned: 0 in 0.401s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0" returned: 0 in 0.093s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] <== create_volume: return (556ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a52c490-e46c-48a5-8dc8-b91872bfc71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1eb3be8-7e20-4ced-bc12-c393c0ef7fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:43 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Volume volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0 (b970b570-a36b-4368-b7ad-f2e29d3ff8b0): created successfully
Sep 17 15:17:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1eb3be8-7e20-4ced-bc12-c393c0ef7fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Flow 'volume_create_manager' (eacd00e7-2ae0-45f2-8264-466a1ca34587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:44 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c195da7f-f88c-48eb-9546-fcc1972f4d00 tempest-VolumesTestJSON-1994590420 None] Created volume successfully.
Sep 17 15:17:45 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:45 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:17:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Flow 'volume_create_manager' (2c1fef69-c29a-4744-891a-6287cce2a836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f7abe7-7d6f-41bf-90e7-a856230f9d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f7abe7-7d6f-41bf-90e7-a856230f9d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-216120759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a223cad0-624e-4f21-be08-23813528d062,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35dc2a2f43f94feda56265a4d6e2aed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:46Z,use_quota=True,user_id='7daafaf50ff543ccab449a13c2ce0785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca3d4c7-1849-4e0b-af9c-ed7d26638702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca3d4c7-1849-4e0b-af9c-ed7d26638702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22186c1d-64ae-424e-b057-ecfcf2089c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22186c1d-64ae-424e-b057-ecfcf2089c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a223cad0-624e-4f21-be08-23813528d062', 'volume_name': 'volume-a223cad0-624e-4f21-be08-23813528d062', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b31744-e892-4ee9-bfd1-f244451a9183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b31744-e892-4ee9-bfd1-f244451a9183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9a2962-6832-4964-93c6-b2502b7f0f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:46 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Volume a223cad0-624e-4f21-be08-23813528d062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a223cad0-624e-4f21-be08-23813528d062', 'volume_size': 1}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-216120759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a223cad0-624e-4f21-be08-23813528d062,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35dc2a2f43f94feda56265a4d6e2aed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:17:46Z,use_quota=True,user_id='7daafaf50ff543ccab449a13c2ce0785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Creating volume a223cad0-624e-4f21-be08-23813528d062 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:17:46 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a223cad0-624e-4f21-be08-23813528d062 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:46 devstack quobyte-client[83236]: System call of process 89074 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:17:46 devstack quobyte-client[83236]: System call of process 89074 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:17:46 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=19, name=volume-a223cad0-624e-4f21-be08-23813528d062, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a223cad0-624e-4f21-be08-23813528d062 1073741824" returned: 0 in 0.381s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a223cad0-624e-4f21-be08-23813528d062 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a223cad0-624e-4f21-be08-23813528d062" returned: 0 in 0.119s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] <== create_volume: return (563ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.576s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9a2962-6832-4964-93c6-b2502b7f0f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a223cad0-624e-4f21-be08-23813528d062', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4d5022-114b-448a-8e44-1caf0c3b4ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:17:46 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Volume volume-a223cad0-624e-4f21-be08-23813528d062 (a223cad0-624e-4f21-be08-23813528d062): created successfully
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4d5022-114b-448a-8e44-1caf0c3b4ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:17:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Flow 'volume_create_manager' (2c1fef69-c29a-4744-891a-6287cce2a836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:17:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-199ad066-8af5-479b-a64a-630158dbff73 tempest-VolumesTestJSON-1994590420 None] Created volume successfully.
Sep 17 15:17:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Acquiring lock "cinder-a223cad0-624e-4f21-be08-23813528d062-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Lock "cinder-a223cad0-624e-4f21-be08-23813528d062-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:50 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Acquiring lock "cinder-quobyte-a223cad0-624e-4f21-be08-23813528d062" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Lock "cinder-quobyte-a223cad0-624e-4f21-be08-23813528d062" acquired by "delete_volume" :: waited 0.009s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:50 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[158860aa-9bdb-47a9-bf64-d9c55f338084]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:17:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a223cad0-624e-4f21-be08-23813528d062 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a223cad0-624e-4f21-be08-23813528d062" returned: 0 in 0.556s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a223cad0-624e-4f21-be08-23813528d062 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a223cad0-624e-4f21-be08-23813528d062" returned: 0 in 0.118s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Lock "cinder-quobyte-a223cad0-624e-4f21-be08-23813528d062" released by "delete_volume" :: held 0.865s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Created reservations ['a67a81c2-f0ff-496f-9155-7bea9a86f37c', '0bc21e19-b340-44fe-9368-74fa9b6aae1a', '6ac595ef-6feb-4741-bde2-0e08be2a2b7c', '90524d68-c879-4bbf-b91a-f674c75833f0'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.118s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:17:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Deleted volume successfully.
Sep 17 15:17:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32328e95-80ba-4628-8592-c8803a0b760a tempest-VolumesTestJSON-1994590420 None] Lock "cinder-a223cad0-624e-4f21-be08-23813528d062-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Acquiring lock "cinder-b970b570-a36b-4368-b7ad-f2e29d3ff8b0-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Lock "cinder-b970b570-a36b-4368-b7ad-f2e29d3ff8b0-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:52 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Acquiring lock "cinder-quobyte-b970b570-a36b-4368-b7ad-f2e29d3ff8b0" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Lock "cinder-quobyte-b970b570-a36b-4368-b7ad-f2e29d3ff8b0" acquired by "delete_volume" :: waited 0.020s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:52 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[6457f1a8-3b6c-405d-8ee5-3c95cfbd904a]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:17:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:53 devstack quobyte-client[83236]: System call of process 89089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:17:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0" returned: 0 in 1.074s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b970b570-a36b-4368-b7ad-f2e29d3ff8b0" returned: 0 in 0.304s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Lock "cinder-quobyte-b970b570-a36b-4368-b7ad-f2e29d3ff8b0" released by "delete_volume" :: held 1.784s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Created reservations ['e3fa1b3e-cf76-4fb2-85e3-44901f01994a', '9d76bdc2-8735-4a03-b6ae-de330c9df9bc', 'e4fdcca9-5e83-4232-ad6c-bf57bc4a95f3', '3404497d-306f-4e60-940d-5a10d44c8b8e'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.087s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:55 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:17:55 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Deleted volume successfully.
Sep 17 15:17:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a9287e02-9831-44c5-ad57-4b36a7e0e97a tempest-VolumesTestJSON-1994590420 None] Lock "cinder-b970b570-a36b-4368-b7ad-f2e29d3ff8b0-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Acquiring lock "cinder-f83497bf-bb94-4e5b-90f5-26cbb86e4f44-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Lock "cinder-f83497bf-bb94-4e5b-90f5-26cbb86e4f44-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:56 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:17:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Acquiring lock "cinder-quobyte-f83497bf-bb94-4e5b-90f5-26cbb86e4f44" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:17:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Lock "cinder-quobyte-f83497bf-bb94-4e5b-90f5-26cbb86e4f44" acquired by "delete_volume" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:17:56 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcc2465-37f8-42da-bcee-556e9d836dba]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:17:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44" returned: 0 in 0.581s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f83497bf-bb94-4e5b-90f5-26cbb86e4f44" returned: 0 in 0.104s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Lock "cinder-quobyte-f83497bf-bb94-4e5b-90f5-26cbb86e4f44" released by "delete_volume" :: held 0.859s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Created reservations ['66048210-9776-4fde-a5f2-e61a21ca9150', '8f8325b8-4742-4403-b0ae-f07a0699ba70', 'a841169b-d541-4675-88ad-5038e0e0b49a', '82157b50-eda0-4cba-8089-59994accd317'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.107s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:17:57 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Deleted volume successfully.
Sep 17 15:17:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d7963147-ab9e-48e9-90d9-6a57bb1c8581 tempest-VolumesTestJSON-1994590420 None] Lock "cinder-f83497bf-bb94-4e5b-90f5-26cbb86e4f44-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:18:07 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=32,cinder:UPDATE=35,cinder:DELETE=7,cinder:INSERT=12 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:18:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:18:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:18:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:18:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.437s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:18:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=79,cinder:SELECT=43,cinder:DELETE=4,cinder:INSERT=12 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:18:24 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Flow 'volume_create_manager' (b458cd02-6e0b-47b2-8948-359cfafdbc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3079c8de-da56-42ae-9580-ad778dec82e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3079c8de-da56-42ae-9580-ad778dec82e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1691621074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138ff981-98a6-4158-a453-4be757f30be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bff5ac49a9e44568f4cd39ff42c99ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:18:24Z,use_quota=True,user_id='510a51cb8f7d44fc9b1819fa707e7055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7e90bb-e857-49ab-991c-e53baf10c145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7e90bb-e857-49ab-991c-e53baf10c145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5dded0-b799-494b-acf8-de798f0a6d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5dded0-b799-494b-acf8-de798f0a6d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138ff981-98a6-4158-a453-4be757f30be4', 'volume_name': 'volume-138ff981-98a6-4158-a453-4be757f30be4', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f3b504-7b2e-486f-a3b5-f864456b2577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f3b504-7b2e-486f-a3b5-f864456b2577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ec5121-9563-4b76-854e-bb1639a0cb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:24 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Volume 138ff981-98a6-4158-a453-4be757f30be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138ff981-98a6-4158-a453-4be757f30be4', 'volume_size': 1}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1691621074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138ff981-98a6-4158-a453-4be757f30be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bff5ac49a9e44568f4cd39ff42c99ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:18:24Z,use_quota=True,user_id='510a51cb8f7d44fc9b1819fa707e7055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Creating volume 138ff981-98a6-4158-a453-4be757f30be4 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:18:24 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:18:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-138ff981-98a6-4158-a453-4be757f30be4 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:24 devstack quobyte-client[83236]: System call of process 89268 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:18:24 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=20, name=volume-138ff981-98a6-4158-a453-4be757f30be4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:18:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-138ff981-98a6-4158-a453-4be757f30be4 1073741824" returned: 0 in 0.564s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-138ff981-98a6-4158-a453-4be757f30be4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-138ff981-98a6-4158-a453-4be757f30be4" returned: 0 in 0.233s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] <== create_volume: return (924ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:18:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ec5121-9563-4b76-854e-bb1639a0cb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138ff981-98a6-4158-a453-4be757f30be4', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40e84b1-308d-4f39-9af4-3a9ad1b7c99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Volume volume-138ff981-98a6-4158-a453-4be757f30be4 (138ff981-98a6-4158-a453-4be757f30be4): created successfully
Sep 17 15:18:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40e84b1-308d-4f39-9af4-3a9ad1b7c99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Flow 'volume_create_manager' (b458cd02-6e0b-47b2-8948-359cfafdbc0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:18:25 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c340e51e-596e-4c0a-ac29-f9e494830cb6 tempest-VolumesServicesTestJSON-1179424461 None] Created volume successfully.
Sep 17 15:18:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Acquiring lock "cinder-138ff981-98a6-4158-a453-4be757f30be4-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:18:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Lock "cinder-138ff981-98a6-4158-a453-4be757f30be4-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:18:26 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:18:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Acquiring lock "cinder-quobyte-138ff981-98a6-4158-a453-4be757f30be4" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:18:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Lock "cinder-quobyte-138ff981-98a6-4158-a453-4be757f30be4" acquired by "delete_volume" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:18:26 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[21684468-3e9b-4158-b91a-60f7bf202410]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:18:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-138ff981-98a6-4158-a453-4be757f30be4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-138ff981-98a6-4158-a453-4be757f30be4" returned: 0 in 0.478s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-138ff981-98a6-4158-a453-4be757f30be4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-138ff981-98a6-4158-a453-4be757f30be4" returned: 0 in 0.101s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Lock "cinder-quobyte-138ff981-98a6-4158-a453-4be757f30be4" released by "delete_volume" :: held 0.739s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Created reservations ['82c1184a-9e2c-4325-a2c3-1f208b18e345', '9ac88190-03e0-4176-9c30-fcdfe7b58d36', 'e119a40f-df31-4dfd-82e9-72d1e178e886', 'f601c979-737c-400e-b3d5-685902c5c479'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.120s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:28 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:18:28 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Deleted volume successfully.
Sep 17 15:18:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80f26643-2059-4f56-a30c-925b4994da9f tempest-VolumesServicesTestJSON-1179424461 None] Lock "cinder-138ff981-98a6-4158-a453-4be757f30be4-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:18:37 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=11,cinder:SELECT=8 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:18:38 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:18:40 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Flow 'volume_create_manager' (cbbaf21f-cc4e-452d-9265-508ee0248335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3979456d-ab31-447c-8b6d-016c9655036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3979456d-ab31-447c-8b6d-016c9655036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1934989903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b881ea-034d-4a4e-b609-47f1eb2068c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae4d930601486bbc3c3eea7b8c73f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:18:40Z,use_quota=True,user_id='8ae81cfe2d564bfeb3433170ae0c8353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc33321-a817-4a41-9773-faf5c4671bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc33321-a817-4a41-9773-faf5c4671bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1baec8-0c81-480e-b8d9-fdc3eecaa765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1baec8-0c81-480e-b8d9-fdc3eecaa765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b881ea-034d-4a4e-b609-47f1eb2068c2', 'volume_name': 'volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ef3fea-7a6f-4a89-81b9-67f8c8a87192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ef3fea-7a6f-4a89-81b9-67f8c8a87192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8625da-1c20-4827-9a48-09e430121706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:40 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Volume c2b881ea-034d-4a4e-b609-47f1eb2068c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2', 'volume_size': 1}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1934989903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b881ea-034d-4a4e-b609-47f1eb2068c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae4d930601486bbc3c3eea7b8c73f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:18:40Z,use_quota=True,user_id='8ae81cfe2d564bfeb3433170ae0c8353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Creating volume c2b881ea-034d-4a4e-b609-47f1eb2068c2 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:18:40 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:40 devstack quobyte-client[83236]: System call of process 89299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:18:40 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=21, name=volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2 1073741824" returned: 0 in 0.457s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2" returned: 0 in 0.289s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] <== create_volume: return (858ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:18:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8625da-1c20-4827-9a48-09e430121706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37962487-4998-4111-bbd9-402069a69a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:41 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Volume volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2 (c2b881ea-034d-4a4e-b609-47f1eb2068c2): created successfully
Sep 17 15:18:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37962487-4998-4111-bbd9-402069a69a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Flow 'volume_create_manager' (cbbaf21f-cc4e-452d-9265-508ee0248335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:18:41 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-0255b51e-d2cb-4535-b643-8f3c38c45799 tempest-AttachVolumeTestJSON-570979370 None] Created volume successfully.
Sep 17 15:18:44 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Flow 'volume_create_manager' (61a42dc3-bbb8-4ac9-aa0a-f66cef334f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70995207-79ff-4b7a-862e-385d65fef9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70995207-79ff-4b7a-862e-385d65fef9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2045313978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a52898-84e6-44f9-9e49-3d37d006c398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e4f222711f4b62877c46b8d26af98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:18:44Z,use_quota=True,user_id='aa58a0828d184eab9d0c16eafd6e818a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba78503c-6d57-4eab-a03d-a7fab1887a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba78503c-6d57-4eab-a03d-a7fab1887a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11bd1dc-6f44-441f-b7f8-9a4ef52456f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11bd1dc-6f44-441f-b7f8-9a4ef52456f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a52898-84e6-44f9-9e49-3d37d006c398', 'volume_name': 'volume-06a52898-84e6-44f9-9e49-3d37d006c398', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065c5e56-643b-47e8-89a9-50db91566899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065c5e56-643b-47e8-89a9-50db91566899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfb2b41-30da-4948-93ad-ee89464a84ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:44 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Volume 06a52898-84e6-44f9-9e49-3d37d006c398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a52898-84e6-44f9-9e49-3d37d006c398', 'volume_size': 1}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2045313978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a52898-84e6-44f9-9e49-3d37d006c398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e4f222711f4b62877c46b8d26af98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:18:44Z,use_quota=True,user_id='aa58a0828d184eab9d0c16eafd6e818a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Creating volume 06a52898-84e6-44f9-9e49-3d37d006c398 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:18:44 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:44 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=22, name=volume-06a52898-84e6-44f9-9e49-3d37d006c398, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 1073741824" returned: 0 in 0.359s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398" returned: 0 in 0.112s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] <== create_volume: return (548ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:18:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.561s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfb2b41-30da-4948-93ad-ee89464a84ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a52898-84e6-44f9-9e49-3d37d006c398', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df96b7f-b48c-4bce-913c-b91724336a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:18:45 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Volume volume-06a52898-84e6-44f9-9e49-3d37d006c398 (06a52898-84e6-44f9-9e49-3d37d006c398): created successfully
Sep 17 15:18:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df96b7f-b48c-4bce-913c-b91724336a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:18:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Flow 'volume_create_manager' (61a42dc3-bbb8-4ac9-aa0a-f66cef334f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:18:45 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9c133605-3e3a-457e-b039-e3172bc37016 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Created volume successfully.
Sep 17 15:18:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-ee6d8534-f943-48a4-a8fe-28348f188ae1 req-821eb102-4045-42fc-a9d0-0e7d2c204941 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-ee6d8534-f943-48a4-a8fe-28348f188ae1 req-821eb102-4045-42fc-a9d0-0e7d2c204941 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:46 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[130c01ca-1b42-4b7c-becb-eea5dbb25343]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:18:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-ee6d8534-f943-48a4-a8fe-28348f188ae1 req-821eb102-4045-42fc-a9d0-0e7d2c204941 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-ee6d8534-f943-48a4-a8fe-28348f188ae1 req-821eb102-4045-42fc-a9d0-0e7d2c204941 tempest-AttachVolumeTestJSON-570979370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2" returned: 0 in 0.702s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-ee6d8534-f943-48a4-a8fe-28348f188ae1 req-821eb102-4045-42fc-a9d0-0e7d2c204941 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.733s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.133s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-ee6d8534-f943-48a4-a8fe-28348f188ae1 req-821eb102-4045-42fc-a9d0-0e7d2c204941 tempest-AttachVolumeTestJSON-570979370 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4864f4a-977c-4603-aed6-ac8c0b08d1a7', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:18:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-ee6d8534-f943-48a4-a8fe-28348f188ae1 req-821eb102-4045-42fc-a9d0-0e7d2c204941 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Creating offline snapshot 85f14416-ca07-4b3d-b98b-a2a1a3de88d9 of volume 06a52898-84e6-44f9-9e49-3d37d006c398 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3809ecec-c239-41e3-b501-e8be81baccfe]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:47 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-ee6d8534-f943-48a4-a8fe-28348f188ae1 req-821eb102-4045-42fc-a9d0-0e7d2c204941 tempest-AttachVolumeTestJSON-570979370 None] attachment_update completed successfully.
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398" returned: 0 in 0.568s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:48 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=23, name=volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 1G" returned: 0 in 0.344s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): qemu-img rebase -u -b volume-06a52898-84e6-44f9-9e49-3d37d006c398 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "qemu-img rebase -u -b volume-06a52898-84e6-44f9-9e49-3d37d006c398 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9" returned: 0 in 0.184s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9" returned: 0 in 0.142s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9" returned: 0 in 0.183s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.info" returned: 0 in 0.151s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:18:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.info" returned: 0 in 0.088s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9607886e-916c-4ad6-af07-6673214834c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Create snapshot completed successfully
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Acquiring lock "cinder-85f14416-ca07-4b3d-b98b-a2a1a3de88d9-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-85f14416-ca07-4b3d-b98b-a2a1a3de88d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:18:50 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Acquiring lock "cinder-quobyte-06a52898-84e6-44f9-9e49-3d37d006c398" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-quobyte-06a52898-84e6-44f9-9e49-3d37d006c398" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Acquiring lock "cinder-quobyte-85f14416-ca07-4b3d-b98b-a2a1a3de88d9" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-quobyte-85f14416-ca07-4b3d-b98b-a2a1a3de88d9" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Deleting offline snapshot 85f14416-ca07-4b3d-b98b-a2a1a3de88d9 of volume 06a52898-84e6-44f9-9e49-3d37d006c398 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] snapshot_file for this snap is: volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[855bad04-2d89-4c14-b187-b3db745aea13]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:18:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9" returned: 0 in 0.375s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a52898-84e6-44f9-9e49-3d37d006c398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:18:51 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d5935a-c1dc-4473-b4c4-99d8240d09f6]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:18:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398" returned: 0 in 0.492s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9" returned: 0 in 0.198s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398.85f14416-ca07-4b3d-b98b-a2a1a3de88d9" returned: 0 in 0.088s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-quobyte-85f14416-ca07-4b3d-b98b-a2a1a3de88d9" released by "_delete_snapshot" :: held 1.486s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:18:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-quobyte-06a52898-84e6-44f9-9e49-3d37d006c398" released by "delete_snapshot" :: held 1.543s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:18:52 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Created reservations ['d0308b38-5e85-4641-babc-fee220476acb', '99dac9d0-883d-442e-b87e-df7d52f9e968', '08c4a69c-2b85-4003-afbf-ec0f527b6b44', '054d86fa-36af-44c0-b41c-4ac4e8959774'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:18:52 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Delete snapshot completed successfully.
Sep 17 15:18:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7113c6e0-1160-453e-92f6-f210f496e903 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-85f14416-ca07-4b3d-b98b-a2a1a3de88d9-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Acquiring lock "cinder-06a52898-84e6-44f9-9e49-3d37d006c398-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-06a52898-84e6-44f9-9e49-3d37d006c398-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:18:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Acquiring lock "cinder-quobyte-06a52898-84e6-44f9-9e49-3d37d006c398" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-quobyte-06a52898-84e6-44f9-9e49-3d37d006c398" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[40221e25-7ed0-4c4f-9cc2-a77c575a99fc]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398" returned: 0 in 0.481s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-06a52898-84e6-44f9-9e49-3d37d006c398" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-quobyte-06a52898-84e6-44f9-9e49-3d37d006c398" released by "delete_volume" :: held 0.715s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:18:54 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Created reservations ['6522f2e0-64fd-4dcb-a3fa-378de17e80a0', '25341241-5190-4da6-af7b-e2490821acd5', '4484f19f-e035-4fb1-acde-131300b921b6', '29d00cbc-c8f1-4f74-ab44-3a598df2f4a3'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:18:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:18:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:18:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:18:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:18:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:18:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:18:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.229s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:18:54 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:18:54 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Deleted volume successfully.
Sep 17 15:18:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d17fd526-3240-4777-b211-533b808019d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1509112098 None] Lock "cinder-06a52898-84e6-44f9-9e49-3d37d006c398-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:19:03 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:19:03 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:19:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Flow 'volume_create_manager' (3efd851b-5563-4293-9c5b-ab47232fb581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:19:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ea2166-8694-4267-b3cf-be013a2d2c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ea2166-8694-4267-b3cf-be013a2d2c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-463095197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9162f617-bc98-4b08-a899-5d7e20bd0e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5852387bd9b749acb17fdf44c5ff3dc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:19:04Z,use_quota=True,user_id='2631d1025a3d4e6d8c32ab535bec7f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d1144e-1250-4044-907e-0d3bebae3687),volume_type_id=75d1144e-1250-4044-907e-0d3bebae3687)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db12a811-706b-46e6-b11a-13dfe13a5eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db12a811-706b-46e6-b11a-13dfe13a5eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93073ff-06d1-4171-b160-8dcce9fe98de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93073ff-06d1-4171-b160-8dcce9fe98de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9162f617-bc98-4b08-a899-5d7e20bd0e1c', 'volume_name': 'volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9532175-cf68-4aca-be12-266bfd51199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9532175-cf68-4aca-be12-266bfd51199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b39c81c-11b3-4e9c-86b3-c6b2c067c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:04 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Volume 9162f617-bc98-4b08-a899-5d7e20bd0e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c', 'volume_size': 1}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-463095197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9162f617-bc98-4b08-a899-5d7e20bd0e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5852387bd9b749acb17fdf44c5ff3dc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:19:04Z,use_quota=True,user_id='2631d1025a3d4e6d8c32ab535bec7f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d1144e-1250-4044-907e-0d3bebae3687),volume_type_id=75d1144e-1250-4044-907e-0d3bebae3687)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Creating volume 9162f617-bc98-4b08-a899-5d7e20bd0e1c {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:19:04 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:19:04 devstack quobyte-client[83236]: System call of process 89856 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:19:04 devstack quobyte-client[83236]: System call of process 89856 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:19:04 devstack quobyte-client[83236]: System call of process 89856 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:19:04 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=25, name=volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c 1073741824" returned: 0 in 0.338s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c" returned: 0 in 0.077s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] <== create_volume: return (503ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.516s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b39c81c-11b3-4e9c-86b3-c6b2c067c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc495ca-2e88-41ce-afdd-600ffcd87eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:04 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Volume volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c (9162f617-bc98-4b08-a899-5d7e20bd0e1c): created successfully
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc495ca-2e88-41ce-afdd-600ffcd87eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Flow 'volume_create_manager' (3efd851b-5563-4293-9c5b-ab47232fb581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:19:04 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f6124d9c-2a4f-4f4b-9950-b6468c4169af tempest-VolumeTypesAccessTest-265498886 None] Created volume successfully.
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Acquiring lock "cinder-9162f617-bc98-4b08-a899-5d7e20bd0e1c-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Lock "cinder-9162f617-bc98-4b08-a899-5d7e20bd0e1c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:19:06 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Acquiring lock "cinder-quobyte-9162f617-bc98-4b08-a899-5d7e20bd0e1c" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Lock "cinder-quobyte-9162f617-bc98-4b08-a899-5d7e20bd0e1c" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e496839-e23d-47dd-86c1-8ead84be1d68]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c" returned: 0 in 0.463s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9162f617-bc98-4b08-a899-5d7e20bd0e1c" returned: 0 in 0.076s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:19:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Lock "cinder-quobyte-9162f617-bc98-4b08-a899-5d7e20bd0e1c" released by "delete_volume" :: held 0.693s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:19:07 devstack cinder-volume[83214]: WARNING cinder.quota [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1402842695 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1402842695, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:19:07 devstack cinder-volume[83214]: WARNING cinder.quota [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1402842695 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1402842695, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Created reservations ['0d65f438-0cd8-4294-a4f6-14eff006eb96', 'd211b17f-c376-4591-9422-ab8d3e202027', 'e82c7f9d-48b7-4143-a1db-3ecff4d76774', 'f25cc720-9c99-4579-a38f-e3bbf6f4607b'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.078s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:19:07 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Deleted volume successfully.
Sep 17 15:19:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-495b3b1c-8987-4112-b1e9-b6239275a5dd tempest-VolumeTypesAccessTest-265498886 None] Lock "cinder-9162f617-bc98-4b08-a899-5d7e20bd0e1c-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:19:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:19:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:19:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:19:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:19:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:19:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:19:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:19:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.342s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:19:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:19:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=34,cinder:DELETE=5,cinder:SELECT=25,cinder:INSERT=11 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:19:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:19:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:19:30 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:19:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Flow 'volume_create_manager' (525df2c7-3f9e-4bed-8d77-193ea3fb992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:19:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ba6110-b0ad-4151-a802-0351c0c8e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ba6110-b0ad-4151-a802-0351c0c8e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-795666311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ec4779-f982-4354-8f13-a71ba91b1e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c6111c2cd043788666933a365dce41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:19:30Z,use_quota=True,user_id='93462c229f8f491ab00052074e0a10c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca1e80d-cad3-482e-9583-826b336610eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca1e80d-cad3-482e-9583-826b336610eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b9dc40-4a4d-42b8-9989-e08d63b9d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b9dc40-4a4d-42b8-9989-e08d63b9d13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ec4779-f982-4354-8f13-a71ba91b1e29', 'volume_name': 'volume-d1ec4779-f982-4354-8f13-a71ba91b1e29', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca9da05-d04f-4f3c-90e3-3982ffca55fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca9da05-d04f-4f3c-90e3-3982ffca55fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86df0f3f-b892-4c3b-a91a-c3c18190cf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:31 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume d1ec4779-f982-4354-8f13-a71ba91b1e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ec4779-f982-4354-8f13-a71ba91b1e29', 'volume_size': 1}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-795666311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ec4779-f982-4354-8f13-a71ba91b1e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c6111c2cd043788666933a365dce41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:19:30Z,use_quota=True,user_id='93462c229f8f491ab00052074e0a10c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Creating volume d1ec4779-f982-4354-8f13-a71ba91b1e29 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:19:31 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d1ec4779-f982-4354-8f13-a71ba91b1e29 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:19:31 devstack quobyte-client[83236]: System call of process 90412 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:19:31 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=26, name=volume-d1ec4779-f982-4354-8f13-a71ba91b1e29, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d1ec4779-f982-4354-8f13-a71ba91b1e29 1073741824" returned: 0 in 0.571s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:19:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d1ec4779-f982-4354-8f13-a71ba91b1e29 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:19:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d1ec4779-f982-4354-8f13-a71ba91b1e29" returned: 0 in 0.232s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:19:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] <== create_volume: return (1055ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:19:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:19:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86df0f3f-b892-4c3b-a91a-c3c18190cf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ec4779-f982-4354-8f13-a71ba91b1e29', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6cf51f-312b-4296-979a-0a43020296e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:19:32 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume volume-d1ec4779-f982-4354-8f13-a71ba91b1e29 (d1ec4779-f982-4354-8f13-a71ba91b1e29): created successfully
Sep 17 15:19:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6cf51f-312b-4296-979a-0a43020296e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:19:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Flow 'volume_create_manager' (525df2c7-3f9e-4bed-8d77-193ea3fb992b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:19:32 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-dbb78fa0-a61a-42ba-9d74-708cf230660d tempest-AttachVolumeShelveTestJSON-1007162739 None] Created volume successfully.
Sep 17 15:19:42 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:19:42 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:19:59 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-f1290c2d-0459-47f0-a839-426b5b2a8819 req-fd5df403-f759-426d-b29c-57a994a54e0c tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:19:59 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-f1290c2d-0459-47f0-a839-426b5b2a8819 req-fd5df403-f759-426d-b29c-57a994a54e0c tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:19:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-f1290c2d-0459-47f0-a839-426b5b2a8819 req-fd5df403-f759-426d-b29c-57a994a54e0c tempest-AttachVolumeShelveTestJSON-1007162739 None] No connector for attachment 89d60978-3eb5-4655-a7c5-61923237ccdf; skipping storage backend terminate_connection call. {{(pid=83214) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 17 15:19:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-f1290c2d-0459-47f0-a839-426b5b2a8819 req-fd5df403-f759-426d-b29c-57a994a54e0c tempest-AttachVolumeShelveTestJSON-1007162739 None] Deleting attachment 89d60978-3eb5-4655-a7c5-61923237ccdf. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:20:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:20:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:20:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:20:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:20:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:20:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:20:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:20:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.389s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:20:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:20:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:20:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:20:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (879167f1-a369-4e39-86ef-d1b377d19c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0788d3fd-dbb7-4a2c-99ed-b3ace6b26351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0788d3fd-dbb7-4a2c-99ed-b3ace6b26351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1879610935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d069ba-4c3a-4db7-8543-02b8a73bce13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:20:47Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfc10ac-34be-4d84-b82b-de7d3840ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfc10ac-34be-4d84-b82b-de7d3840ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19db9fd5-2522-4723-af70-89a84016b684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19db9fd5-2522-4723-af70-89a84016b684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86d069ba-4c3a-4db7-8543-02b8a73bce13', 'volume_name': 'volume-86d069ba-4c3a-4db7-8543-02b8a73bce13', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df83997-143a-4e0b-900f-3ecd7fe876f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df83997-143a-4e0b-900f-3ecd7fe876f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea4a085-d2c1-4dc7-bc5e-647a60e69fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:20:47 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Volume 86d069ba-4c3a-4db7-8543-02b8a73bce13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86d069ba-4c3a-4db7-8543-02b8a73bce13', 'volume_size': 1}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1879610935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d069ba-4c3a-4db7-8543-02b8a73bce13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:20:47Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Creating volume 86d069ba-4c3a-4db7-8543-02b8a73bce13 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:20:47 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:20:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-86d069ba-4c3a-4db7-8543-02b8a73bce13 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:20:47 devstack quobyte-client[83236]: System call of process 90819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:20:48 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=27, name=volume-86d069ba-4c3a-4db7-8543-02b8a73bce13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:20:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-86d069ba-4c3a-4db7-8543-02b8a73bce13 1073741824" returned: 0 in 0.436s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:20:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-86d069ba-4c3a-4db7-8543-02b8a73bce13 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:20:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-86d069ba-4c3a-4db7-8543-02b8a73bce13" returned: 0 in 0.160s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:20:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] <== create_volume: return (711ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:20:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:20:48 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea4a085-d2c1-4dc7-bc5e-647a60e69fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d069ba-4c3a-4db7-8543-02b8a73bce13', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:20:48 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebcf292-8387-4682-8869-86fc5da4f348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:20:48 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Volume volume-86d069ba-4c3a-4db7-8543-02b8a73bce13 (86d069ba-4c3a-4db7-8543-02b8a73bce13): created successfully
Sep 17 15:20:48 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebcf292-8387-4682-8869-86fc5da4f348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:20:48 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (879167f1-a369-4e39-86ef-d1b377d19c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:20:48 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-1711985d-f9a8-4451-9c96-07e9aae6ba6d tempest-VolumesActionsTest-1289303652 None] Created volume successfully.
Sep 17 15:20:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6462ff65-d967-415c-998b-9cc44fc3eeb8 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13" by "attach_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:20:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6462ff65-d967-415c-998b-9cc44fc3eeb8 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13" acquired by "attach_volume" :: waited 0.057s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:20:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-6462ff65-d967-415c-998b-9cc44fc3eeb8 tempest-VolumesActionsTest-1289303652 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:20:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-6462ff65-d967-415c-998b-9cc44fc3eeb8 tempest-VolumesActionsTest-1289303652 None] Attaching volume 86d069ba-4c3a-4db7-8543-02b8a73bce13 to instance 0e0812e6-3b45-4b7c-af31-658ce4848897 at mountpoint /dev/vdb on host None.
Sep 17 15:20:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-6462ff65-d967-415c-998b-9cc44fc3eeb8 tempest-VolumesActionsTest-1289303652 None] Attach volume completed successfully.
Sep 17 15:20:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6462ff65-d967-415c-998b-9cc44fc3eeb8 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13" released by "attach_volume" :: held 0.386s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:20:51 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-96ed2249-da0a-4f44-9792-622b0b6dd5c6 tempest-VolumesActionsTest-974370286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:20:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-96ed2249-da0a-4f44-9792-622b0b6dd5c6 tempest-VolumesActionsTest-974370286 None] Terminate volume connection completed successfully.
Sep 17 15:20:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-96ed2249-da0a-4f44-9792-622b0b6dd5c6 tempest-VolumesActionsTest-974370286 None] Acquiring lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13-detach_volume" by "detach_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:20:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-96ed2249-da0a-4f44-9792-622b0b6dd5c6 tempest-VolumesActionsTest-974370286 None] Lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:20:51 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-96ed2249-da0a-4f44-9792-622b0b6dd5c6 tempest-VolumesActionsTest-974370286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:20:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-96ed2249-da0a-4f44-9792-622b0b6dd5c6 tempest-VolumesActionsTest-974370286 None] Detaching volume 86d069ba-4c3a-4db7-8543-02b8a73bce13 from instance 0e0812e6-3b45-4b7c-af31-658ce4848897.
Sep 17 15:20:51 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-96ed2249-da0a-4f44-9792-622b0b6dd5c6 tempest-VolumesActionsTest-974370286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:20:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-96ed2249-da0a-4f44-9792-622b0b6dd5c6 tempest-VolumesActionsTest-974370286 None] Detach volume completed successfully.
Sep 17 15:20:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-96ed2249-da0a-4f44-9792-622b0b6dd5c6 tempest-VolumesActionsTest-974370286 None] Lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:20:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d54d26ae-e49f-40ce-8b33-7bc9c12bd248 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13-detach_volume" by "detach_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:20:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d54d26ae-e49f-40ce-8b33-7bc9c12bd248 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:20:52 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d54d26ae-e49f-40ce-8b33-7bc9c12bd248 tempest-VolumesActionsTest-1289303652 None] Volume detach called, but volume not attached.
Sep 17 15:20:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d54d26ae-e49f-40ce-8b33-7bc9c12bd248 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:20:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:20:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:20:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-20de1829-602c-4015-9119-5324b3041ae4 req-24510127-fd6e-4490-a33d-ecb874587176 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:20:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-20de1829-602c-4015-9119-5324b3041ae4 req-24510127-fd6e-4490-a33d-ecb874587176 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:20:53 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-20de1829-602c-4015-9119-5324b3041ae4 req-24510127-fd6e-4490-a33d-ecb874587176 tempest-AttachVolumeTestJSON-570979370 None] Terminate volume connection completed successfully.
Sep 17 15:20:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-20de1829-602c-4015-9119-5324b3041ae4 req-24510127-fd6e-4490-a33d-ecb874587176 tempest-AttachVolumeTestJSON-570979370 None] Deleting attachment f4864f4a-977c-4603-aed6-ac8c0b08d1a7. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:20:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:20:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "cinder-quobyte-86d069ba-4c3a-4db7-8543-02b8a73bce13" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:20:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-quobyte-86d069ba-4c3a-4db7-8543-02b8a73bce13" acquired by "delete_volume" :: waited 0.018s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:20:53 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4670556f-71be-4452-83f5-6ba3fe9bbeb3]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:20:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-86d069ba-4c3a-4db7-8543-02b8a73bce13 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:20:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-86d069ba-4c3a-4db7-8543-02b8a73bce13" returned: 0 in 0.586s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:20:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-86d069ba-4c3a-4db7-8543-02b8a73bce13 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:20:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-86d069ba-4c3a-4db7-8543-02b8a73bce13" returned: 0 in 0.178s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:20:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-quobyte-86d069ba-4c3a-4db7-8543-02b8a73bce13" released by "delete_volume" :: held 1.235s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:20:55 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Created reservations ['0886a859-c51a-4f4a-80c3-a57e67ed9a15', '049b5ff2-c478-494b-b245-7e927521a160', 'f03eba27-7c82-4d09-a125-9dbef98c4f77', '838827f8-8972-42a5-8ced-763a1aa76675'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:20:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:20:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:20:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:20:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:20:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:20:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:20:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.099s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:20:55 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:20:56 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Deleted volume successfully.
Sep 17 15:20:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fa665894-9443-4daa-99ad-20fac63e2a53 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-86d069ba-4c3a-4db7-8543-02b8a73bce13-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:05 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=8,cinder:INSERT=5,cinder:SELECT=9 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:21:06 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=20,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:21:07 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (dfabeead-d8a2-47a7-b54b-5d6abb763a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dbdb57-d71b-4df8-b8d2-506e46718791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dbdb57-d71b-4df8-b8d2-506e46718791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1473885931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5297ba7b-388c-4368-9cd5-d91b7bdfd135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:08Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdde2f8-df9b-48ec-b0a9-6a1dd40f7231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdde2f8-df9b-48ec-b0a9-6a1dd40f7231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd006235-696b-4e44-9720-8cbf83bf8b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd006235-696b-4e44-9720-8cbf83bf8b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5297ba7b-388c-4368-9cd5-d91b7bdfd135', 'volume_name': 'volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86c0b10-cc8f-403f-8e2d-7d7a2dc6282c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86c0b10-cc8f-403f-8e2d-7d7a2dc6282c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f692272-430c-46b8-aeaf-7d0ae3dc7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:07 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Volume 5297ba7b-388c-4368-9cd5-d91b7bdfd135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135', 'volume_size': 1}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1473885931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5297ba7b-388c-4368-9cd5-d91b7bdfd135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:08Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Creating volume 5297ba7b-388c-4368-9cd5-d91b7bdfd135 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:21:07 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:21:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:07 devstack quobyte-client[83236]: System call of process 90972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:21:07 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=28, name=volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:21:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135 1073741824" returned: 0 in 0.441s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135" returned: 0 in 0.250s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] <== create_volume: return (811ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:21:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f692272-430c-46b8-aeaf-7d0ae3dc7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a81816-7bea-4c02-afee-885aa7053db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:08 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Volume volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135 (5297ba7b-388c-4368-9cd5-d91b7bdfd135): created successfully
Sep 17 15:21:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a81816-7bea-4c02-afee-885aa7053db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (dfabeead-d8a2-47a7-b54b-5d6abb763a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:09 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b1cfa5d4-4ee5-45ee-b15d-f31975cb137f tempest-VolumesActionsTest-1289303652 None] Created volume successfully.
Sep 17 15:21:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Acquiring lock "cinder-5297ba7b-388c-4368-9cd5-d91b7bdfd135-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Lock "cinder-5297ba7b-388c-4368-9cd5-d91b7bdfd135-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:10 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Acquiring lock "cinder-quobyte-5297ba7b-388c-4368-9cd5-d91b7bdfd135" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Lock "cinder-quobyte-5297ba7b-388c-4368-9cd5-d91b7bdfd135" acquired by "delete_volume" :: waited 0.022s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:10 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5471cc-b8e3-491f-857d-74ba2104887e]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:21:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135" returned: 0 in 0.772s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5297ba7b-388c-4368-9cd5-d91b7bdfd135" returned: 0 in 0.131s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:11 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Lock "cinder-quobyte-5297ba7b-388c-4368-9cd5-d91b7bdfd135" released by "delete_volume" :: held 1.181s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:11 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Created reservations ['dd56b95b-c4b2-41a5-bb8f-a4c015313834', '946cb635-721c-471c-a8d4-a7d41f983d04', '66ddaabf-15e5-4fd3-9a46-8ad95f9ee858', '571d6aae-267f-45f1-b93b-95826a9a78e5'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:21:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.135s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:21:12 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Deleted volume successfully.
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-38066035-f76f-4917-bfdf-acf14c736b1a tempest-VolumesActionsTest-974370286 None] Lock "cinder-5297ba7b-388c-4368-9cd5-d91b7bdfd135-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:13 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (bfae17c8-61b3-40a4-bf56-a9ae231056f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22277fd0-adbd-40bc-b1dd-8c95f9d12bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22277fd0-adbd-40bc-b1dd-8c95f9d12bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-690763748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc31509f-037d-46eb-9840-2b6962e39d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:13Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0306ac17-17cd-4eb9-9d00-c6a48ad8224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0306ac17-17cd-4eb9-9d00-c6a48ad8224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0e629b-4b34-4469-9e58-afefae711d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0e629b-4b34-4469-9e58-afefae711d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc31509f-037d-46eb-9840-2b6962e39d98', 'volume_name': 'volume-cc31509f-037d-46eb-9840-2b6962e39d98', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c70d94-bec5-4fd3-8bae-12f6480d9bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c70d94-bec5-4fd3-8bae-12f6480d9bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d936acf-326c-498e-8292-4bbb5c664a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:13 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Volume cc31509f-037d-46eb-9840-2b6962e39d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc31509f-037d-46eb-9840-2b6962e39d98', 'volume_size': 1}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-690763748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc31509f-037d-46eb-9840-2b6962e39d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:13Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Creating volume cc31509f-037d-46eb-9840-2b6962e39d98 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:21:13 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:21:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-cc31509f-037d-46eb-9840-2b6962e39d98 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:13 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=29, name=volume-cc31509f-037d-46eb-9840-2b6962e39d98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:21:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-cc31509f-037d-46eb-9840-2b6962e39d98 1073741824" returned: 0 in 0.329s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-cc31509f-037d-46eb-9840-2b6962e39d98 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-cc31509f-037d-46eb-9840-2b6962e39d98" returned: 0 in 0.255s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:14 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] <== create_volume: return (784ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:21:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d936acf-326c-498e-8292-4bbb5c664a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc31509f-037d-46eb-9840-2b6962e39d98', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4892349-cf72-4fd0-a007-883f8f97a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:14 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Volume volume-cc31509f-037d-46eb-9840-2b6962e39d98 (cc31509f-037d-46eb-9840-2b6962e39d98): created successfully
Sep 17 15:21:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4892349-cf72-4fd0-a007-883f8f97a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (bfae17c8-61b3-40a4-bf56-a9ae231056f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:14 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-cc3544d6-d6e2-4ca3-9335-dfc6dd0b834d tempest-VolumesActionsTest-1289303652 None] Created volume successfully.
Sep 17 15:21:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Acquiring lock "cinder-cc31509f-037d-46eb-9840-2b6962e39d98-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Lock "cinder-cc31509f-037d-46eb-9840-2b6962e39d98-delete_volume" acquired by "delete_volume" :: waited 0.287s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:17 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Acquiring lock "cinder-quobyte-cc31509f-037d-46eb-9840-2b6962e39d98" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Lock "cinder-quobyte-cc31509f-037d-46eb-9840-2b6962e39d98" acquired by "delete_volume" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:17 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4d0963-d184-420a-857c-bae44978c5ec]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:21:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-cc31509f-037d-46eb-9840-2b6962e39d98 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:18 devstack quobyte-client[83236]: System call of process 91051 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:21:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-cc31509f-037d-46eb-9840-2b6962e39d98" returned: 0 in 1.339s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-cc31509f-037d-46eb-9840-2b6962e39d98 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-cc31509f-037d-46eb-9840-2b6962e39d98" returned: 0 in 0.327s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Lock "cinder-quobyte-cc31509f-037d-46eb-9840-2b6962e39d98" released by "delete_volume" :: held 2.168s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:20 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Created reservations ['b4c2224f-6b69-4f71-85a6-41306daa31fc', '5ba413fc-55b0-40ff-9a1d-08a128b04e89', '59a38bb0-620f-40d6-b053-70b12eecb4e4', '508d0f88-bda0-4626-b5f4-6759616bf23d'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:21:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.179s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:20 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:21:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Deleted volume successfully.
Sep 17 15:21:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-360af538-5414-4e1e-a31b-d0e3390e2cd4 tempest-VolumesActionsTest-974370286 None] Lock "cinder-cc31509f-037d-46eb-9840-2b6962e39d98-delete_volume" released by "delete_volume" :: held 4.263s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:22 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (136d4434-171b-4dcd-9cc8-4084136b3561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acff9b4f-815f-46b8-ac10-03420d260159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acff9b4f-815f-46b8-ac10-03420d260159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2022800647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5c33ce-b01d-49b8-87b5-2e7143f46183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:22Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6869ea8f-3e99-46c9-89e9-409aaab6afb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6869ea8f-3e99-46c9-89e9-409aaab6afb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bf3952-d7b2-4498-8eac-ab30a46decb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bf3952-d7b2-4498-8eac-ab30a46decb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5c33ce-b01d-49b8-87b5-2e7143f46183', 'volume_name': 'volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85a0897-23dc-4e45-896e-1b54409409a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85a0897-23dc-4e45-896e-1b54409409a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0cbf9b-c466-42a7-bafb-b6471dbb69ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:22 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Volume 1c5c33ce-b01d-49b8-87b5-2e7143f46183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183', 'volume_size': 1}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2022800647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5c33ce-b01d-49b8-87b5-2e7143f46183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:22Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Creating volume 1c5c33ce-b01d-49b8-87b5-2e7143f46183 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:21:22 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:21:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:22 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=30, name=volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:21:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183 1073741824" returned: 0 in 0.441s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183" returned: 0 in 0.197s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] <== create_volume: return (779ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:21:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0cbf9b-c466-42a7-bafb-b6471dbb69ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659752f9-7d95-4905-a09d-611044357f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:23 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Volume volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183 (1c5c33ce-b01d-49b8-87b5-2e7143f46183): created successfully
Sep 17 15:21:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659752f9-7d95-4905-a09d-611044357f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (136d4434-171b-4dcd-9cc8-4084136b3561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:23 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f56fdd26-d41b-4406-9eff-fa0392f4669f tempest-VolumesActionsTest-1289303652 None] Created volume successfully.
Sep 17 15:21:24 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Acquiring lock "cinder-1c5c33ce-b01d-49b8-87b5-2e7143f46183-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:24 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Lock "cinder-1c5c33ce-b01d-49b8-87b5-2e7143f46183-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:25 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Acquiring lock "cinder-quobyte-1c5c33ce-b01d-49b8-87b5-2e7143f46183" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Lock "cinder-quobyte-1c5c33ce-b01d-49b8-87b5-2e7143f46183" acquired by "delete_volume" :: waited 0.021s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:25 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b8eb92-b81d-4bc8-9161-5b6beb80a5db]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:21:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183" returned: 0 in 0.435s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1c5c33ce-b01d-49b8-87b5-2e7143f46183" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Lock "cinder-quobyte-1c5c33ce-b01d-49b8-87b5-2e7143f46183" released by "delete_volume" :: held 0.681s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Created reservations ['7afbd5eb-f826-4dbd-83f4-fe45fecb47a6', 'bcc4ec26-9ffb-43e7-bb24-704b134a1195', '2d74b97c-766d-44b8-a897-3a98f749bd80', '81023380-2e8c-465b-bd2e-46d527ab2e6c'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.127s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:21:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Deleted volume successfully.
Sep 17 15:21:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-97117942-330c-43a7-8998-7bb9b4135ccb tempest-VolumesActionsTest-974370286 None] Lock "cinder-1c5c33ce-b01d-49b8-87b5-2e7143f46183-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:27 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (dc3c720c-f9a2-4495-aa8c-29621cbeb84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77459ef6-fe6e-4416-ab6a-2e3c911ac21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77459ef6-fe6e-4416-ab6a-2e3c911ac21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-590079733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491cb84e-1932-4575-b0cf-0a2f83ee3cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:27Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb78d36f-484e-4525-aa20-d04a6a0cf4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb78d36f-484e-4525-aa20-d04a6a0cf4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddccdc2-ba46-4fcd-bf03-19fea1d81177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddccdc2-ba46-4fcd-bf03-19fea1d81177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491cb84e-1932-4575-b0cf-0a2f83ee3cfa', 'volume_name': 'volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e32d19-2e07-4551-97f2-a353805eb34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e32d19-2e07-4551-97f2-a353805eb34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898d9e0d-1502-4658-b2ab-96258a7398d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:27 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Volume 491cb84e-1932-4575-b0cf-0a2f83ee3cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa', 'volume_size': 1}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-590079733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491cb84e-1932-4575-b0cf-0a2f83ee3cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:27Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Creating volume 491cb84e-1932-4575-b0cf-0a2f83ee3cfa {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:21:27 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:21:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:27 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=31, name=volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:21:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa 1073741824" returned: 0 in 0.289s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] <== create_volume: return (438ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:21:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.460s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898d9e0d-1502-4658-b2ab-96258a7398d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5568b0b6-5f9a-4ef8-8610-ed8305dcbc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:28 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Volume volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa (491cb84e-1932-4575-b0cf-0a2f83ee3cfa): created successfully
Sep 17 15:21:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5568b0b6-5f9a-4ef8-8610-ed8305dcbc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (dc3c720c-f9a2-4495-aa8c-29621cbeb84b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:28 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d8fa371e-c82b-466d-b4e5-26ac6565cfe9 tempest-VolumesActionsTest-1289303652 None] Created volume successfully.
Sep 17 15:21:29 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Acquiring lock "cinder-491cb84e-1932-4575-b0cf-0a2f83ee3cfa-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:29 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Lock "cinder-491cb84e-1932-4575-b0cf-0a2f83ee3cfa-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Acquiring lock "cinder-quobyte-491cb84e-1932-4575-b0cf-0a2f83ee3cfa" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Lock "cinder-quobyte-491cb84e-1932-4575-b0cf-0a2f83ee3cfa" acquired by "delete_volume" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:30 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d2da58-79eb-4369-a0c4-59a39d40f373]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:21:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa" returned: 0 in 0.412s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-491cb84e-1932-4575-b0cf-0a2f83ee3cfa" returned: 0 in 0.106s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Lock "cinder-quobyte-491cb84e-1932-4575-b0cf-0a2f83ee3cfa" released by "delete_volume" :: held 0.674s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:30 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Created reservations ['34067431-1577-4038-9cc6-d42a54b203e5', '229e4ced-b246-4578-ba89-3812fc5f9880', '393dfa98-2577-4dbd-b882-ca345ec9a150', '0527fbc6-1132-437a-80c2-5faf5cfabc3d'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:21:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.222s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:31 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:21:31 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Deleted volume successfully.
Sep 17 15:21:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-674079dc-4ca4-46ed-8608-d1df0214ad6c tempest-VolumesActionsTest-974370286 None] Lock "cinder-491cb84e-1932-4575-b0cf-0a2f83ee3cfa-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:32 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:32 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:21:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (f41f2d28-0018-488c-b6c6-e4a52a2fabd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72057c0e-ea9d-4de2-a7cf-1590efb52aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72057c0e-ea9d-4de2-a7cf-1590efb52aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-168864939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b23b3cc-d146-4211-8737-64ba443da0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:33Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d1331b-dd31-447e-91e9-e34b958fd802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d1331b-dd31-447e-91e9-e34b958fd802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa6c807-6896-4ad1-8dd8-3017f6cc6e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa6c807-6896-4ad1-8dd8-3017f6cc6e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b23b3cc-d146-4211-8737-64ba443da0b3', 'volume_name': 'volume-7b23b3cc-d146-4211-8737-64ba443da0b3', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc54628-753c-4549-a207-e07bca58cf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc54628-753c-4549-a207-e07bca58cf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955d82bc-a0f8-4aa2-b4a6-307518fe1451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:33 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Volume 7b23b3cc-d146-4211-8737-64ba443da0b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b23b3cc-d146-4211-8737-64ba443da0b3', 'volume_size': 1}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-168864939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b23b3cc-d146-4211-8737-64ba443da0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46de23b96423455d832cc95ccfde5d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:21:33Z,use_quota=True,user_id='0cab54fd84fe47e58573a0f2aaa915f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Creating volume 7b23b3cc-d146-4211-8737-64ba443da0b3 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:21:33 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b23b3cc-d146-4211-8737-64ba443da0b3 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:33 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=32, name=volume-7b23b3cc-d146-4211-8737-64ba443da0b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b23b3cc-d146-4211-8737-64ba443da0b3 1073741824" returned: 0 in 0.364s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b23b3cc-d146-4211-8737-64ba443da0b3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b23b3cc-d146-4211-8737-64ba443da0b3" returned: 0 in 0.110s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] <== create_volume: return (540ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.555s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955d82bc-a0f8-4aa2-b4a6-307518fe1451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b23b3cc-d146-4211-8737-64ba443da0b3', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e1894d-f9fe-4f7c-a5ee-1adfd04989ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:21:33 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Volume volume-7b23b3cc-d146-4211-8737-64ba443da0b3 (7b23b3cc-d146-4211-8737-64ba443da0b3): created successfully
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e1894d-f9fe-4f7c-a5ee-1adfd04989ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:21:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Flow 'volume_create_manager' (f41f2d28-0018-488c-b6c6-e4a52a2fabd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:21:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-42db5375-a2ef-4e40-afe0-f97440a959c0 tempest-VolumesActionsTest-1289303652 None] Created volume successfully.
Sep 17 15:21:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "cinder-7b23b3cc-d146-4211-8737-64ba443da0b3-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-7b23b3cc-d146-4211-8737-64ba443da0b3-delete_volume" acquired by "delete_volume" :: waited 0.143s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:21:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "cinder-quobyte-7b23b3cc-d146-4211-8737-64ba443da0b3" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:21:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-quobyte-7b23b3cc-d146-4211-8737-64ba443da0b3" acquired by "delete_volume" :: waited 0.021s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:21:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bc54de-82ff-4bf2-a59b-a76e5c2c9b86]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:21:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b23b3cc-d146-4211-8737-64ba443da0b3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:37 devstack quobyte-client[83236]: System call of process 91125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:21:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b23b3cc-d146-4211-8737-64ba443da0b3" returned: 0 in 0.820s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b23b3cc-d146-4211-8737-64ba443da0b3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b23b3cc-d146-4211-8737-64ba443da0b3" returned: 0 in 0.250s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-quobyte-7b23b3cc-d146-4211-8737-64ba443da0b3" released by "delete_volume" :: held 1.369s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:38 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Created reservations ['9ed59877-206c-44bb-b48c-7b4c768ce46c', 'c2f50df5-1229-4f71-b8e1-6ba5166adf5f', '613021df-0540-409a-b177-502151710ee7', '983e8faa-4269-476c-aa54-2a1c9db34dff'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:21:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:21:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:21:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:21:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:21:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:21:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:21:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.524s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:21:39 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:21:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Deleted volume successfully.
Sep 17 15:21:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ab123e54-b1a3-419d-822a-6fb50dd5bc29 tempest-VolumesActionsTest-1289303652 None] Lock "cinder-7b23b3cc-d146-4211-8737-64ba443da0b3-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:21:48 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=51,cinder:SELECT=28,cinder:INSERT=18,cinder:DELETE=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:21:50 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=32,cinder:DELETE=6,cinder:INSERT=2,cinder:UPDATE=49 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:22:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "cinder-d1ec4779-f982-4354-8f13-a71ba91b1e29-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "cinder-d1ec4779-f982-4354-8f13-a71ba91b1e29-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:00 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "cinder-quobyte-d1ec4779-f982-4354-8f13-a71ba91b1e29" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "cinder-quobyte-d1ec4779-f982-4354-8f13-a71ba91b1e29" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:00 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d534ab-0f17-49dc-b3ba-e2db9c29646e]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d1ec4779-f982-4354-8f13-a71ba91b1e29 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:01 devstack quobyte-client[83236]: System call of process 91215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d1ec4779-f982-4354-8f13-a71ba91b1e29" returned: 0 in 0.884s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d1ec4779-f982-4354-8f13-a71ba91b1e29 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d1ec4779-f982-4354-8f13-a71ba91b1e29" returned: 0 in 0.262s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "cinder-quobyte-d1ec4779-f982-4354-8f13-a71ba91b1e29" released by "delete_volume" :: held 1.534s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:02 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Created reservations ['47a7d50b-db83-41de-9425-8945570e6563', 'e5ab24e5-a904-447a-b852-471184a426ac', '515a906d-7622-417a-8753-6903ec5086e3', '4c8ccec1-2ab2-4b31-8502-892de49fc9f2'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.180s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:03 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "cinder-7b4e8e21-bb5a-4720-af04-b796f55fe6b1-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Deleted volume successfully.
Sep 17 15:22:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ae16ccfa-2709-4e0f-a103-df5f7ec9002c tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "cinder-d1ec4779-f982-4354-8f13-a71ba91b1e29-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "cinder-7b4e8e21-bb5a-4720-af04-b796f55fe6b1-delete_volume" acquired by "delete_volume" :: waited 0.207s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:03 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "cinder-quobyte-7b4e8e21-bb5a-4720-af04-b796f55fe6b1" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "cinder-quobyte-7b4e8e21-bb5a-4720-af04-b796f55fe6b1" acquired by "delete_volume" :: waited 0.015s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:03 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e73e6f7-161d-4328-9502-3849271038d8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:04 devstack quobyte-client[83236]: System call of process 91253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1" returned: 0 in 0.702s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:04 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Flow 'volume_create_manager' (90f6e48c-8bb2-49c0-9cd9-2844c7e73e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9293b10-4d0e-4824-af85-7d51995dbf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7b4e8e21-bb5a-4720-af04-b796f55fe6b1" returned: 0 in 0.342s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "cinder-quobyte-7b4e8e21-bb5a-4720-af04-b796f55fe6b1" released by "delete_volume" :: held 1.189s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9293b10-4d0e-4824-af85-7d51995dbf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1239976243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6171d6d4-fbf8-4656-a5df-eb80ff0be073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b478b7bf45f409a96728dfa5790b09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:04Z,use_quota=True,user_id='32f576b251cf41b094e2dea76bf734aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2681849-6d3e-40b3-86e2-239dbad8b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2681849-6d3e-40b3-86e2-239dbad8b07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d6e4e8-ec60-4c71-8276-f65055bbd7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d6e4e8-ec60-4c71-8276-f65055bbd7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6171d6d4-fbf8-4656-a5df-eb80ff0be073', 'volume_name': 'volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde1b359-4422-4d2a-87b9-2c3948336e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde1b359-4422-4d2a-87b9-2c3948336e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5e8e26-2880-4119-9c9c-fd6b374cbaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:04 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Volume 6171d6d4-fbf8-4656-a5df-eb80ff0be073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073', 'volume_size': 1}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1239976243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6171d6d4-fbf8-4656-a5df-eb80ff0be073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b478b7bf45f409a96728dfa5790b09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:04Z,use_quota=True,user_id='32f576b251cf41b094e2dea76bf734aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Creating volume 6171d6d4-fbf8-4656-a5df-eb80ff0be073 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:22:04 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:22:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:04 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=33, name=volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073 1073741824" returned: 0 in 0.478s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Created reservations ['2259547e-e520-4495-9dad-6fa6575bc734', '4cb6627b-ff40-419b-8778-ea9387e41bad', '2ba40cf0-ad61-4941-b368-9187157a3c62', '2a8c26b7-d17f-411c-9ecc-dd52f1ad47c7'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073" returned: 0 in 0.243s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] <== create_volume: return (752ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5e8e26-2880-4119-9c9c-fd6b374cbaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697e81b3-1156-41f2-8cc0-6f8f4e52fd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:05 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Volume volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073 (6171d6d4-fbf8-4656-a5df-eb80ff0be073): created successfully
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697e81b3-1156-41f2-8cc0-6f8f4e52fd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Flow 'volume_create_manager' (90f6e48c-8bb2-49c0-9cd9-2844c7e73e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:05 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c2aa3b46-94ad-4c36-8b64-ab32dd8a32a5 tempest-VolumesListAdminTestJSON-1267485794 None] Created volume successfully.
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.098s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:05 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:05 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Deleted volume successfully.
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2de19b23-6be8-4b16-ae80-5acefe5fb4dd tempest-AttachVolumeShelveTestJSON-1007162739 None] Lock "cinder-7b4e8e21-bb5a-4720-af04-b796f55fe6b1-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:06 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Flow 'volume_create_manager' (01177b7c-3dc7-49d2-83a1-00d7a250c1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d57f96-a3a4-43ff-88e5-e7f28bbbc975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d57f96-a3a4-43ff-88e5-e7f28bbbc975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1281740087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6711b3c4-db9f-4309-ba67-4e70557d9d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b478b7bf45f409a96728dfa5790b09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:06Z,use_quota=True,user_id='32f576b251cf41b094e2dea76bf734aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8ceb0e-b406-4b7e-838d-bb137b12f53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8ceb0e-b406-4b7e-838d-bb137b12f53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5824887-32bc-4196-90c4-853cae79b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5824887-32bc-4196-90c4-853cae79b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6711b3c4-db9f-4309-ba67-4e70557d9d83', 'volume_name': 'volume-6711b3c4-db9f-4309-ba67-4e70557d9d83', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582633b5-016b-4eb1-a265-f96f3712c032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582633b5-016b-4eb1-a265-f96f3712c032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef720a88-9636-414f-a555-c1d5f7c472cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:06 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Volume 6711b3c4-db9f-4309-ba67-4e70557d9d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6711b3c4-db9f-4309-ba67-4e70557d9d83', 'volume_size': 1}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1281740087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6711b3c4-db9f-4309-ba67-4e70557d9d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b478b7bf45f409a96728dfa5790b09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:06Z,use_quota=True,user_id='32f576b251cf41b094e2dea76bf734aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Creating volume 6711b3c4-db9f-4309-ba67-4e70557d9d83 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:22:06 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:22:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6711b3c4-db9f-4309-ba67-4e70557d9d83 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:06 devstack quobyte-client[83236]: System call of process 91262 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:06 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=34, name=volume-6711b3c4-db9f-4309-ba67-4e70557d9d83, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6711b3c4-db9f-4309-ba67-4e70557d9d83 1073741824" returned: 0 in 0.342s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6711b3c4-db9f-4309-ba67-4e70557d9d83 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6711b3c4-db9f-4309-ba67-4e70557d9d83" returned: 0 in 0.268s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] <== create_volume: return (661ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:22:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef720a88-9636-414f-a555-c1d5f7c472cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6711b3c4-db9f-4309-ba67-4e70557d9d83', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0279775-9ff7-41a3-b9e6-25f81941e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:07 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Volume volume-6711b3c4-db9f-4309-ba67-4e70557d9d83 (6711b3c4-db9f-4309-ba67-4e70557d9d83): created successfully
Sep 17 15:22:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0279775-9ff7-41a3-b9e6-25f81941e210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Flow 'volume_create_manager' (01177b7c-3dc7-49d2-83a1-00d7a250c1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:07 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-49be99e0-f337-4a09-afb0-98e36d1a8d2b tempest-VolumesListAdminTestJSON-1267485794 None] Created volume successfully.
Sep 17 15:22:09 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Flow 'volume_create_manager' (dfc82fe7-5b62-4f79-a913-1e6f12a34226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275bd211-b8f2-44cf-9e17-43b3c9470801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275bd211-b8f2-44cf-9e17-43b3c9470801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1113214615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efd3331-899a-488c-a610-030bca804a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b478b7bf45f409a96728dfa5790b09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:09Z,use_quota=True,user_id='32f576b251cf41b094e2dea76bf734aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398c51fc-9a89-49e0-9417-13f278b24cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398c51fc-9a89-49e0-9417-13f278b24cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc78739-b6a5-4120-a142-2470484fd6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc78739-b6a5-4120-a142-2470484fd6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efd3331-899a-488c-a610-030bca804a0d', 'volume_name': 'volume-7efd3331-899a-488c-a610-030bca804a0d', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b00511-2551-40c8-b021-c1afc053f77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b00511-2551-40c8-b021-c1afc053f77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b3b243-fdef-4a4c-a8bc-f4dcdab3bb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:09 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Volume 7efd3331-899a-488c-a610-030bca804a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efd3331-899a-488c-a610-030bca804a0d', 'volume_size': 1}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1113214615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efd3331-899a-488c-a610-030bca804a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b478b7bf45f409a96728dfa5790b09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:09Z,use_quota=True,user_id='32f576b251cf41b094e2dea76bf734aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Creating volume 7efd3331-899a-488c-a610-030bca804a0d {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:22:09 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7efd3331-899a-488c-a610-030bca804a0d 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:09 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=35, name=volume-7efd3331-899a-488c-a610-030bca804a0d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7efd3331-899a-488c-a610-030bca804a0d 1073741824" returned: 0 in 0.344s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7efd3331-899a-488c-a610-030bca804a0d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7efd3331-899a-488c-a610-030bca804a0d" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] <== create_volume: return (498ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:22:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.509s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b3b243-fdef-4a4c-a8bc-f4dcdab3bb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efd3331-899a-488c-a610-030bca804a0d', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2b860e-14a8-4243-9db7-5dcb952d82f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:10 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Volume volume-7efd3331-899a-488c-a610-030bca804a0d (7efd3331-899a-488c-a610-030bca804a0d): created successfully
Sep 17 15:22:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2b860e-14a8-4243-9db7-5dcb952d82f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Flow 'volume_create_manager' (dfc82fe7-5b62-4f79-a913-1e6f12a34226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:10 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d64a5164-cb19-4e75-a576-7f4650764410 tempest-VolumesListAdminTestJSON-1267485794 None] Created volume successfully.
Sep 17 15:22:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:22:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.403s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:12 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Flow 'volume_create_manager' (1fadf20c-35ec-464a-8f17-80e3dedcae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da066cd-9428-406c-800e-81275fc47e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da066cd-9428-406c-800e-81275fc47e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d789ee-c67c-4681-8fe7-da75806e08be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021868f1e44a40858f399d9779e8f313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:12Z,use_quota=True,user_id='ea58081e4efa47e29084064a92ec9932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c6c365-abe8-413e-9894-f79b7d156940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c6c365-abe8-413e-9894-f79b7d156940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80791447-9c65-4db4-8adc-c02f85c422e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80791447-9c65-4db4-8adc-c02f85c422e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d789ee-c67c-4681-8fe7-da75806e08be', 'volume_name': 'volume-26d789ee-c67c-4681-8fe7-da75806e08be', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c357a0-6e01-4686-bd01-277e3d3d555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c357a0-6e01-4686-bd01-277e3d3d555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30efa6ed-6368-4740-bc0e-20078ce8a685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:12 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Volume 26d789ee-c67c-4681-8fe7-da75806e08be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d789ee-c67c-4681-8fe7-da75806e08be', 'volume_size': 1}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d789ee-c67c-4681-8fe7-da75806e08be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021868f1e44a40858f399d9779e8f313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:12Z,use_quota=True,user_id='ea58081e4efa47e29084064a92ec9932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Creating volume 26d789ee-c67c-4681-8fe7-da75806e08be {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:22:12 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:22:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-26d789ee-c67c-4681-8fe7-da75806e08be 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:12 devstack quobyte-client[83236]: System call of process 91274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:12 devstack quobyte-client[83236]: System call of process 91274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:12 devstack quobyte-client[83236]: System call of process 91274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:12 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=36, name=volume-26d789ee-c67c-4681-8fe7-da75806e08be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-26d789ee-c67c-4681-8fe7-da75806e08be 1073741824" returned: 0 in 0.375s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-26d789ee-c67c-4681-8fe7-da75806e08be {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-26d789ee-c67c-4681-8fe7-da75806e08be" returned: 0 in 0.187s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] <== create_volume: return (629ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:22:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.643s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30efa6ed-6368-4740-bc0e-20078ce8a685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d789ee-c67c-4681-8fe7-da75806e08be', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb4d51f-476f-4a80-8402-6efc2af2a79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:13 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Volume volume-26d789ee-c67c-4681-8fe7-da75806e08be (26d789ee-c67c-4681-8fe7-da75806e08be): created successfully
Sep 17 15:22:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb4d51f-476f-4a80-8402-6efc2af2a79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Flow 'volume_create_manager' (1fadf20c-35ec-464a-8f17-80e3dedcae5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:13 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c6233762-5dcb-4432-83be-54712bab3e9d tempest-VolumesListAdminTestJSON-1525891613 None] Created volume successfully.
Sep 17 15:22:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Acquiring lock "cinder-26d789ee-c67c-4681-8fe7-da75806e08be-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "cinder-26d789ee-c67c-4681-8fe7-da75806e08be-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "cinder-7efd3331-899a-488c-a610-030bca804a0d-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Acquiring lock "cinder-quobyte-26d789ee-c67c-4681-8fe7-da75806e08be" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-7efd3331-899a-488c-a610-030bca804a0d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "cinder-quobyte-26d789ee-c67c-4681-8fe7-da75806e08be" acquired by "delete_volume" :: waited 0.027s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:14 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[12819696-043c-4465-9f48-c55a3ab13a65]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-26d789ee-c67c-4681-8fe7-da75806e08be {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:15 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "cinder-quobyte-7efd3331-899a-488c-a610-030bca804a0d" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-quobyte-7efd3331-899a-488c-a610-030bca804a0d" acquired by "delete_volume" :: waited 0.056s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:15 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[391ef660-d78c-4350-9c25-f492af4b932b]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7efd3331-899a-488c-a610-030bca804a0d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-26d789ee-c67c-4681-8fe7-da75806e08be" returned: 0 in 0.943s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-26d789ee-c67c-4681-8fe7-da75806e08be {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-26d789ee-c67c-4681-8fe7-da75806e08be" returned: 0 in 0.207s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "cinder-quobyte-26d789ee-c67c-4681-8fe7-da75806e08be" released by "delete_volume" :: held 1.449s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7efd3331-899a-488c-a610-030bca804a0d" returned: 0 in 1.049s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7efd3331-899a-488c-a610-030bca804a0d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:16 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Created reservations ['f8e3139b-ae45-40a1-8b2c-e69c2fb14dbb', 'a235a408-8791-424c-b63b-819b59c5c200', '807ce89c-8cf7-49bd-98b2-db6875cbd97d', '65e67aca-81e6-484f-81a1-17fb4f714982'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7efd3331-899a-488c-a610-030bca804a0d" returned: 0 in 0.337s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-quobyte-7efd3331-899a-488c-a610-030bca804a0d" released by "delete_volume" :: held 1.606s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Created reservations ['66294584-f48d-477b-83ac-b56cdcfe38e4', 'fc883a22-7819-44fc-8ed2-3ffc41e97e9d', 'c0b715ea-3f21-4ea4-8a10-606179c66904', '100ba3f8-cdf3-46ef-a19f-11b6940aa3d6'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.496s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:17 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Deleted volume successfully.
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.163s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:18 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:18 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Deleted volume successfully.
Sep 17 15:22:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-50ef7480-4907-4d5c-ba5a-1fd2af88594d tempest-VolumesListAdminTestJSON-1525891613 None] Lock "cinder-26d789ee-c67c-4681-8fe7-da75806e08be-delete_volume" released by "delete_volume" :: held 3.704s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8404df7f-f08e-4e01-ba6e-ad3da74d08cf tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-7efd3331-899a-488c-a610-030bca804a0d-delete_volume" released by "delete_volume" :: held 3.654s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "cinder-6711b3c4-db9f-4309-ba67-4e70557d9d83-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-6711b3c4-db9f-4309-ba67-4e70557d9d83-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:18 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "cinder-quobyte-6711b3c4-db9f-4309-ba67-4e70557d9d83" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-quobyte-6711b3c4-db9f-4309-ba67-4e70557d9d83" acquired by "delete_volume" :: waited 0.018s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:18 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1019a627-d9bb-4489-8b90-bd59e5d8e206]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6711b3c4-db9f-4309-ba67-4e70557d9d83 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6711b3c4-db9f-4309-ba67-4e70557d9d83" returned: 0 in 0.501s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6711b3c4-db9f-4309-ba67-4e70557d9d83 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6711b3c4-db9f-4309-ba67-4e70557d9d83" returned: 0 in 0.123s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-quobyte-6711b3c4-db9f-4309-ba67-4e70557d9d83" released by "delete_volume" :: held 0.793s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:19 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Created reservations ['d3c823ca-f927-4949-b2b2-b9ec91824c8d', '67fad64a-346c-4c9c-ab4a-444ca8a8d52e', '0b98edd7-db89-4ca3-99c8-daad1b59331c', '096c7552-97b5-4d3b-bf90-e4248fcc6feb'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Deleted volume successfully.
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-99b8e3f6-21da-480c-8da1-cf386a126ffb tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-6711b3c4-db9f-4309-ba67-4e70557d9d83-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "cinder-6171d6d4-fbf8-4656-a5df-eb80ff0be073-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-6171d6d4-fbf8-4656-a5df-eb80ff0be073-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:21 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "cinder-quobyte-6171d6d4-fbf8-4656-a5df-eb80ff0be073" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-quobyte-6171d6d4-fbf8-4656-a5df-eb80ff0be073" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbfe388-9154-4e73-ab44-3e7048252929]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-54e0998b-b8bb-4d8f-8a8d-6cfc7835bab9 tempest-BackendsCapabilitiesAdminTestsJSON-1369956839 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154777526855, 'free_capacity_gb': 924.9154777526855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83214) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073" returned: 0 in 0.490s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6171d6d4-fbf8-4656-a5df-eb80ff0be073" returned: 0 in 0.105s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5fc7d364-771b-4c25-a752-79cc28a83d4b tempest-BackendsCapabilitiesAdminTestsJSON-1369956839 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154777526855, 'free_capacity_gb': 924.9154777526855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83214) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 17 15:22:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-quobyte-6171d6d4-fbf8-4656-a5df-eb80ff0be073" released by "delete_volume" :: held 0.815s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Created reservations ['c874b78e-f1e7-4df1-b17a-b13bc38aaca7', '24dda932-5151-4b13-af7d-7e043cfd4645', 'a9c301d2-9ef4-4994-8ecd-60a1be680b7c', '636ce495-47e0-47df-a459-4254bc25824a'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.184s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:22 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Deleted volume successfully.
Sep 17 15:22:22 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5946d6a1-18dc-411d-b7f4-99881490ed0d tempest-VolumesListAdminTestJSON-1267485794 None] Lock "cinder-6171d6d4-fbf8-4656-a5df-eb80ff0be073-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Flow 'volume_create_manager' (0d4d3ae4-344f-499c-913f-de9cf7486cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eccbb7-5ed7-4139-a823-ac9df0f69c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eccbb7-5ed7-4139-a823-ac9df0f69c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-942870314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e784ecf-bd97-47d3-aa03-a6f21e8b4325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131e60937cbf40e1a70cbfe12995f3d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:28Z,use_quota=True,user_id='7ffc16800eed465b9d91c81204b46120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df8f36c-4a5d-43a0-b373-c88af3852782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df8f36c-4a5d-43a0-b373-c88af3852782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3880a740-073c-4080-9be3-ac1a678fab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3880a740-073c-4080-9be3-ac1a678fab26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e784ecf-bd97-47d3-aa03-a6f21e8b4325', 'volume_name': 'volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325', 'volume_size': 2}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8108701d-d469-4a4b-a442-9577850fafc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8108701d-d469-4a4b-a442-9577850fafc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5be752-eed9-4df2-8545-1cd75d7c8898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:28 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Volume 6e784ecf-bd97-47d3-aa03-a6f21e8b4325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325', 'volume_size': 2}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-942870314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e784ecf-bd97-47d3-aa03-a6f21e8b4325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131e60937cbf40e1a70cbfe12995f3d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:28Z,use_quota=True,user_id='7ffc16800eed465b9d91c81204b46120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Creating volume 6e784ecf-bd97-47d3-aa03-a6f21e8b4325 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:22:28 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:22:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325 2147483648 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:28 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=37, name=volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:29 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c04b8698-c9b2-4395-be51-cd3044f786f0 tempest-GroupSnapshotsV319Test-405768647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:29 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c04b8698-c9b2-4395-be51-cd3044f786f0 tempest-GroupSnapshotsV319Test-405768647 None] Group tempest-GroupSnapshotsV319Test-Group-510750323: creating
Sep 17 15:22:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325 2147483648" returned: 0 in 0.615s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325" returned: 0 in 0.277s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] <== create_volume: return (931ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:22:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5be752-eed9-4df2-8545-1cd75d7c8898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325', 'volume_size': 2}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9741e526-ac20-43a4-a24d-5263182b920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:29 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c04b8698-c9b2-4395-be51-cd3044f786f0 tempest-GroupSnapshotsV319Test-405768647 None] Group tempest-GroupSnapshotsV319Test-Group-510750323: created successfully
Sep 17 15:22:29 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c04b8698-c9b2-4395-be51-cd3044f786f0 tempest-GroupSnapshotsV319Test-405768647 None] Create group completed successfully.
Sep 17 15:22:29 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Volume volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325 (6e784ecf-bd97-47d3-aa03-a6f21e8b4325): created successfully
Sep 17 15:22:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9741e526-ac20-43a4-a24d-5263182b920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Flow 'volume_create_manager' (0d4d3ae4-344f-499c-913f-de9cf7486cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:29 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f9fb9a03-9c31-4dc7-a1f4-0da4b0adb1ee tempest-VolumesCloneNegativeTest-878144985 None] Created volume successfully.
Sep 17 15:22:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Flow 'volume_create_manager' (979a7a85-11ae-4b48-bb08-1e7738e43345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c542cf29-5f31-4f67-be86-24522e42f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c542cf29-5f31-4f67-be86-24522e42f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-676715808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a08c530b-948c-4573-b548-e638f3cb5d52,host='devstack@QuobyteHD#QuobyteHD',id=b5d556a8-54e8-4d52-a43c-0cf9bc363dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d05fe695c2b4b078e38988bb7ad5b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:30Z,use_quota=True,user_id='d2739103265246a389037778a22c77a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2e55bd0-68b8-49d6-b4ac-81e8b3abbb16),volume_type_id=f2e55bd0-68b8-49d6-b4ac-81e8b3abbb16)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6723057f-49b5-4bb9-bfc5-2699967ac6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6723057f-49b5-4bb9-bfc5-2699967ac6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d478cf08-66ba-4ce7-9a39-6847c0026a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d478cf08-66ba-4ce7-9a39-6847c0026a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d556a8-54e8-4d52-a43c-0cf9bc363dd0', 'volume_name': 'volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da8dc46-d98e-4590-87b3-ddc4017d8dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da8dc46-d98e-4590-87b3-ddc4017d8dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e669cc0f-7180-40c9-a9f5-bde06dbaaba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:30 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Volume b5d556a8-54e8-4d52-a43c-0cf9bc363dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0', 'volume_size': 1}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a08c530b-948c-4573-b548-e638f3cb5d52,created_at=2025-09-17T13:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-676715808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a08c530b-948c-4573-b548-e638f3cb5d52,host='devstack@QuobyteHD#QuobyteHD',id=b5d556a8-54e8-4d52-a43c-0cf9bc363dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d05fe695c2b4b078e38988bb7ad5b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:30Z,use_quota=True,user_id='d2739103265246a389037778a22c77a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2e55bd0-68b8-49d6-b4ac-81e8b3abbb16),volume_type_id=f2e55bd0-68b8-49d6-b4ac-81e8b3abbb16)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Creating volume b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:22:30 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:30 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=38, name=volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Acquiring lock "cinder-6e784ecf-bd97-47d3-aa03-a6f21e8b4325-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 1073741824" returned: 0 in 0.473s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Lock "cinder-6e784ecf-bd97-47d3-aa03-a6f21e8b4325-delete_volume" acquired by "delete_volume" :: waited 0.319s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" returned: 0 in 0.342s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] <== create_volume: return (863ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e669cc0f-7180-40c9-a9f5-bde06dbaaba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3c7ec1-63a3-41e2-bb96-6beb50288cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:31 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Volume volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 (b5d556a8-54e8-4d52-a43c-0cf9bc363dd0): created successfully
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3c7ec1-63a3-41e2-bb96-6beb50288cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Flow 'volume_create_manager' (979a7a85-11ae-4b48-bb08-1e7738e43345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:31 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-18bd8d20-97e6-4f70-b4dc-bbaa0f750726 tempest-GroupSnapshotsV319Test-405768647 None] Created volume successfully.
Sep 17 15:22:31 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Acquiring lock "cinder-quobyte-6e784ecf-bd97-47d3-aa03-a6f21e8b4325" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Lock "cinder-quobyte-6e784ecf-bd97-47d3-aa03-a6f21e8b4325" acquired by "delete_volume" :: waited 0.022s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d569b2-a38f-4ccf-bc16-1913d6b6579f]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325" returned: 0 in 0.478s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6e784ecf-bd97-47d3-aa03-a6f21e8b4325" returned: 0 in 0.078s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Lock "cinder-quobyte-6e784ecf-bd97-47d3-aa03-a6f21e8b4325" released by "delete_volume" :: held 0.698s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:32 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Created reservations ['4eeaaf85-657b-4c79-8c7f-fea3fddf2550', '4872f103-8847-4b16-b72a-8d09c784f351', '2a6e5e56-72b8-4984-b7fd-4b5535417c15', '255d52b5-c55e-4a4d-89cf-cf030e67fa3d'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] GroupSnapshot 75186253-759a-4bff-b97d-0c65ecae8dbd: creating.
Sep 17 15:22:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.929s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:34 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:34 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Group snapshot 75186253-759a-4bff-b97d-0c65ecae8dbd: creating. {{(pid=83214) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 15:22:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Deleted volume successfully.
Sep 17 15:22:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Creating offline snapshot ad0d668d-4574-4cfe-9458-c58ba3fb1d57 of volume b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:22:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a607742-144e-4b3e-9835-73362c9be35e tempest-VolumesCloneNegativeTest-878144985 None] Lock "cinder-6e784ecf-bd97-47d3-aa03-a6f21e8b4325-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:34 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bbb3d4-3efc-4ae2-9f76-64c5a2efb774]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" returned: 0 in 0.527s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:35 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=39, name=volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 1G" returned: 0 in 0.272s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] CMD "qemu-img rebase -u -b volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57" returned: 0 in 0.266s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:22:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57" returned: 0 in 0.144s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:22:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57" returned: 0 in 0.243s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.info" returned: 0 in 0.262s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:22:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.info" returned: 0 in 0.339s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:38 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-fdbf4c26-faab-469e-8e31-389b812dc81d tempest-GroupSnapshotsV319Test-405768647 None] group_snapshot 75186253-759a-4bff-b97d-0c65ecae8dbd: created successfully
Sep 17 15:22:40 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] group_snapshot 75186253-759a-4bff-b97d-0c65ecae8dbd: deleting
Sep 17 15:22:40 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] group_snapshot 75186253-759a-4bff-b97d-0c65ecae8dbd: deleting {{(pid=83214) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Acquiring lock "cinder-quobyte-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Lock "cinder-quobyte-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Acquiring lock "cinder-quobyte-ad0d668d-4574-4cfe-9458-c58ba3fb1d57" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Lock "cinder-quobyte-ad0d668d-4574-4cfe-9458-c58ba3fb1d57" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Deleting offline snapshot ad0d668d-4574-4cfe-9458-c58ba3fb1d57 of volume b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] snapshot_file for this snap is: volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e1436c-6181-40db-a31c-513fc085d922]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57" returned: 0 in 0.501s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[345587e2-5947-4d51-b9fe-cdd6ea0326f3]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" returned: 0 in 0.658s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:41 devstack quobyte-client[83236]: System call of process 91395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57" returned: 0 in 0.233s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0.ad0d668d-4574-4cfe-9458-c58ba3fb1d57" returned: 0 in 0.100s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:42 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Lock "cinder-quobyte-ad0d668d-4574-4cfe-9458-c58ba3fb1d57" released by "_delete_snapshot" :: held 1.831s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:42 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Lock "cinder-quobyte-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" released by "delete_snapshot" :: held 1.869s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:42 devstack cinder-volume[83214]: WARNING cinder.quota [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1796656068 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1796656068, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:22:42 devstack cinder-volume[83214]: WARNING cinder.quota [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1796656068 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1796656068, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:22:42 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] Created reservations ['5bacb3b5-80c7-477f-baae-2337b706b1a6', '0b9571d0-a1cf-4143-860e-1f3a95c20c16', '3d206930-a23b-4b77-a133-e7ea50d267fb', '44d7c448-07aa-4876-a7fe-2fcb39ee3fdf'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-463f32d5-0ebf-4353-a96a-ea35d0ae365a tempest-GroupSnapshotsV319Test-405768647 None] group_snapshot 75186253-759a-4bff-b97d-0c65ecae8dbd: deleted successfully
Sep 17 15:22:43 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Acquiring lock "cinder-quobyte-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Lock "cinder-quobyte-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" acquired by "delete_volume" :: waited 0.034s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[389b395d-2207-4c55-89d5-bd9c067c3819]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:44 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Flow 'volume_create_manager' (3ab7bd5a-a5f6-48b3-9620-2fa2c7ef1204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c2f917-e6a4-4296-a405-7db06dd36b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c2f917-e6a4-4296-a405-7db06dd36b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-575799924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceab0f2a-7a60-47fa-a77c-943257939463,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ecc9402f9f544a487e88f3d5b82edea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:44Z,use_quota=True,user_id='171cb6d1cfb748de8cd795455e83f2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee625a2-19b8-47a0-8472-d7599acb16af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee625a2-19b8-47a0-8472-d7599acb16af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab71346-e043-4d2c-970f-f0cf1c854f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab71346-e043-4d2c-970f-f0cf1c854f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceab0f2a-7a60-47fa-a77c-943257939463', 'volume_name': 'volume-ceab0f2a-7a60-47fa-a77c-943257939463', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8e8c50-3673-4f71-afc8-19ed9f094879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8e8c50-3673-4f71-afc8-19ed9f094879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92838c49-2d4a-450c-9036-4a414fbc3a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:44 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Volume ceab0f2a-7a60-47fa-a77c-943257939463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceab0f2a-7a60-47fa-a77c-943257939463', 'volume_size': 1}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-575799924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceab0f2a-7a60-47fa-a77c-943257939463,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ecc9402f9f544a487e88f3d5b82edea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:44Z,use_quota=True,user_id='171cb6d1cfb748de8cd795455e83f2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Creating volume ceab0f2a-7a60-47fa-a77c-943257939463 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:22:44 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ceab0f2a-7a60-47fa-a77c-943257939463 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" returned: 0 in 0.827s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:45 devstack quobyte-client[83236]: System call of process 91403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:45 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=41, name=volume-ceab0f2a-7a60-47fa-a77c-943257939463, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" returned: 0 in 0.170s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Lock "cinder-quobyte-b5d556a8-54e8-4d52-a43c-0cf9bc363dd0" released by "delete_volume" :: held 1.305s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ceab0f2a-7a60-47fa-a77c-943257939463 1073741824" returned: 0 in 0.780s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ceab0f2a-7a60-47fa-a77c-943257939463 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ceab0f2a-7a60-47fa-a77c-943257939463" returned: 0 in 0.257s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] <== create_volume: return (1081ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92838c49-2d4a-450c-9036-4a414fbc3a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceab0f2a-7a60-47fa-a77c-943257939463', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54d43ca-b48e-4059-983f-119369a5fabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:46 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Volume volume-ceab0f2a-7a60-47fa-a77c-943257939463 (ceab0f2a-7a60-47fa-a77c-943257939463): created successfully
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54d43ca-b48e-4059-983f-119369a5fabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Flow 'volume_create_manager' (3ab7bd5a-a5f6-48b3-9620-2fa2c7ef1204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-73c969d7-7932-439c-a1ce-efd80c26b395 tempest-VolumesListTestJSON-686941847 None] Created volume successfully.
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Created reservations ['0caf55eb-1368-4837-8b58-2afad34b80b0'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:46 devstack cinder-volume[83214]: WARNING cinder.quota [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1796656068 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1796656068, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Created reservations ['562daeca-3485-4f8b-9e9d-dcd1d64a1e9c', '07f6ceb8-907c-42d6-988c-a85eece773bb', '81c4034c-636c-49ad-85da-0dc999b948fc', '712449dd-219e-4029-b115-4f1af05f41db'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.111s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:46 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2818dda2-26d9-4b0f-8fdb-5a7492da69ad tempest-GroupSnapshotsV319Test-405768647 None] Delete group completed successfully.
Sep 17 15:22:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Flow 'volume_create_manager' (bce5104c-328d-41e3-898e-6fa357bfa1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c0a1c2-cc88-49b1-9d64-21ec1104f9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c0a1c2-cc88-49b1-9d64-21ec1104f9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1109204768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96437e7d-f7da-4331-81ad-80971c761345,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ecc9402f9f544a487e88f3d5b82edea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:47Z,use_quota=True,user_id='171cb6d1cfb748de8cd795455e83f2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f575271d-4510-4ec8-b80a-bc8b0b0ba64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f575271d-4510-4ec8-b80a-bc8b0b0ba64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d66ee37-a36c-4fb4-b263-eefe7c373c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d66ee37-a36c-4fb4-b263-eefe7c373c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96437e7d-f7da-4331-81ad-80971c761345', 'volume_name': 'volume-96437e7d-f7da-4331-81ad-80971c761345', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1307b1ec-4c00-4835-ab22-cfe8d9bf466f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1307b1ec-4c00-4835-ab22-cfe8d9bf466f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e66dfea-a187-40a2-98d1-9f9e1ade2d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:47 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Volume 96437e7d-f7da-4331-81ad-80971c761345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96437e7d-f7da-4331-81ad-80971c761345', 'volume_size': 1}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1109204768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96437e7d-f7da-4331-81ad-80971c761345,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ecc9402f9f544a487e88f3d5b82edea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:47Z,use_quota=True,user_id='171cb6d1cfb748de8cd795455e83f2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Creating volume 96437e7d-f7da-4331-81ad-80971c761345 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:22:47 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:22:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96437e7d-f7da-4331-81ad-80971c761345 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:47 devstack quobyte-client[83236]: System call of process 91410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:47 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=42, name=volume-96437e7d-f7da-4331-81ad-80971c761345, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96437e7d-f7da-4331-81ad-80971c761345 1073741824" returned: 0 in 0.462s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96437e7d-f7da-4331-81ad-80971c761345 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96437e7d-f7da-4331-81ad-80971c761345" returned: 0 in 0.208s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] <== create_volume: return (750ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:22:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:48 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e66dfea-a187-40a2-98d1-9f9e1ade2d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96437e7d-f7da-4331-81ad-80971c761345', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:48 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62b21d3-1620-433d-b441-fc1b00305eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:48 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Volume volume-96437e7d-f7da-4331-81ad-80971c761345 (96437e7d-f7da-4331-81ad-80971c761345): created successfully
Sep 17 15:22:48 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62b21d3-1620-433d-b441-fc1b00305eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:48 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Flow 'volume_create_manager' (bce5104c-328d-41e3-898e-6fa357bfa1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:48 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-164cd5e0-4846-463b-9782-6b9362a6c57b tempest-VolumesListTestJSON-686941847 None] Created volume successfully.
Sep 17 15:22:50 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Flow 'volume_create_manager' (bce4aff7-dd8f-4d4c-8a2e-c9a2e36f5075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0961d45b-666d-4b70-94c7-92ee127c3f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0961d45b-666d-4b70-94c7-92ee127c3f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-572695017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d5a9e0-12e1-4041-94d2-1c3c3214b8d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ecc9402f9f544a487e88f3d5b82edea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:50Z,use_quota=True,user_id='171cb6d1cfb748de8cd795455e83f2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8ea5e0-cca3-4fc9-a4a8-314be8dff5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8ea5e0-cca3-4fc9-a4a8-314be8dff5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757245a4-ccc8-44c1-b79e-94f8376aae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757245a4-ccc8-44c1-b79e-94f8376aae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d5a9e0-12e1-4041-94d2-1c3c3214b8d0', 'volume_name': 'volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58a4ff7-35c5-45a3-9576-4204d33dc5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58a4ff7-35c5-45a3-9576-4204d33dc5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759d2ba5-9bc7-432f-92ea-24a9f343437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:50 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Volume 01d5a9e0-12e1-4041-94d2-1c3c3214b8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0', 'volume_size': 1}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-572695017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d5a9e0-12e1-4041-94d2-1c3c3214b8d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ecc9402f9f544a487e88f3d5b82edea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:22:50Z,use_quota=True,user_id='171cb6d1cfb748de8cd795455e83f2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Creating volume 01d5a9e0-12e1-4041-94d2-1c3c3214b8d0 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:22:50 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:50 devstack quobyte-client[83236]: System call of process 91414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:22:50 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=43, name=volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0 1073741824" returned: 0 in 0.376s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0" returned: 0 in 0.164s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] <== create_volume: return (628ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:22:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.644s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759d2ba5-9bc7-432f-92ea-24a9f343437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d46b20a-e7bc-485a-a2d6-b1131f9f0e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:22:51 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Volume volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0 (01d5a9e0-12e1-4041-94d2-1c3c3214b8d0): created successfully
Sep 17 15:22:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d46b20a-e7bc-485a-a2d6-b1131f9f0e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:22:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Flow 'volume_create_manager' (bce4aff7-dd8f-4d4c-8a2e-c9a2e36f5075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:22:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-eac6977c-1121-44fe-b526-25f8ae46940d tempest-VolumesListTestJSON-686941847 None] Created volume successfully.
Sep 17 15:22:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "cinder-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:56 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:22:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "cinder-quobyte-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:22:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-quobyte-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:22:57 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[de87183d-9040-4fb4-9691-0984aceaa0fc]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:22:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0" returned: 0 in 0.834s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0" returned: 0 in 0.267s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-quobyte-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0" released by "delete_volume" :: held 1.389s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:22:58 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=74,cinder:UPDATE=103,cinder:DELETE=9,cinder:INSERT=19 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:22:59 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Created reservations ['5b62baad-c13c-457d-8bb3-d3f64dd56c2b', 'aeec4cd6-27a3-454f-8c45-52e50a9cf6b5', 'c5c54e31-80e6-497f-bb07-e5ee91144d84', '04cb0b31-2a0c-4a2d-9442-f910d08878a0'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:22:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:22:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:22:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:22:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:22:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:22:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:22:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.284s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:22:59 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:22:59 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Deleted volume successfully.
Sep 17 15:23:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-604c4170-1781-4914-91e3-23c038b24864 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-01d5a9e0-12e1-4041-94d2-1c3c3214b8d0-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "cinder-96437e7d-f7da-4331-81ad-80971c761345-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-96437e7d-f7da-4331-81ad-80971c761345-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:00 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=69,cinder:UPDATE=97,cinder:INSERT=22,cinder:DELETE=7 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:23:00 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "cinder-quobyte-96437e7d-f7da-4331-81ad-80971c761345" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-quobyte-96437e7d-f7da-4331-81ad-80971c761345" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:00 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8cd4fd-ed3f-45d6-94bd-8d20a2407ca1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96437e7d-f7da-4331-81ad-80971c761345 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96437e7d-f7da-4331-81ad-80971c761345" returned: 0 in 0.470s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96437e7d-f7da-4331-81ad-80971c761345 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96437e7d-f7da-4331-81ad-80971c761345" returned: 0 in 0.128s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:01 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-quobyte-96437e7d-f7da-4331-81ad-80971c761345" released by "delete_volume" :: held 0.821s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:01 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Created reservations ['8acaf645-0312-4dc6-81c9-17b8ad2b42df', 'c6af6a1d-13a6-4772-b041-3f6d5cc40e27', '3360b3f9-2dbb-4600-affc-bfbb783e2ae1', '8490987d-8c6d-4163-8f1f-ae64a5af6cfd'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.131s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:02 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Deleted volume successfully.
Sep 17 15:23:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a973acf5-cff8-458a-9cfb-663790eac770 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-96437e7d-f7da-4331-81ad-80971c761345-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "cinder-ceab0f2a-7a60-47fa-a77c-943257939463-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:03 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-49f86471-b563-4b25-9652-6defdc0106b0 tempest-GroupsV320Test-1972157825 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-49f86471-b563-4b25-9652-6defdc0106b0 tempest-GroupsV320Test-1972157825 None] Group tempest-GroupsV320Test-Group-1533911969: creating
Sep 17 15:23:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-ceab0f2a-7a60-47fa-a77c-943257939463-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-49f86471-b563-4b25-9652-6defdc0106b0 tempest-GroupsV320Test-1972157825 None] Group tempest-GroupsV320Test-Group-1533911969: created successfully
Sep 17 15:23:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-49f86471-b563-4b25-9652-6defdc0106b0 tempest-GroupsV320Test-1972157825 None] Create group completed successfully.
Sep 17 15:23:03 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "cinder-quobyte-ceab0f2a-7a60-47fa-a77c-943257939463" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-quobyte-ceab0f2a-7a60-47fa-a77c-943257939463" acquired by "delete_volume" :: waited 0.013s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:03 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f5f523-05e0-4e5a-aa01-1dcd6c495e6e]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ceab0f2a-7a60-47fa-a77c-943257939463 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ceab0f2a-7a60-47fa-a77c-943257939463" returned: 0 in 0.445s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ceab0f2a-7a60-47fa-a77c-943257939463 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ceab0f2a-7a60-47fa-a77c-943257939463" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-quobyte-ceab0f2a-7a60-47fa-a77c-943257939463" released by "delete_volume" :: held 0.717s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Created reservations ['a7d930ad-a6d1-405d-af59-8f574418056f', '4c9dc7db-62bb-450e-b83e-d1e7deb94729', 'd34f1c35-1370-409b-9660-701e4ce3bcb6', 'a88d58ef-80df-40a0-bec0-2ce0cf9f83ab'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:04 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:04 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Created reservations ['4d37f853-2020-4024-9228-0834b8132311'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.275s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:05 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Deleted volume successfully.
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f72fedcb-ea81-44b8-9765-d552687e21a5 tempest-VolumesListTestJSON-686941847 None] Lock "cinder-ceab0f2a-7a60-47fa-a77c-943257939463-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.099s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:05 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:05 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-901bf22c-091f-4ea2-9ff0-f712797db171 tempest-GroupsV320Test-1972157825 None] Delete group completed successfully.
Sep 17 15:23:11 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:23:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:12 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:12 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:23:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Flow 'volume_create_manager' (30845ed8-3d39-4308-b755-6c3bd3f0ec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82200f6b-3942-48a0-b3e4-16dd7eec5fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.918s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82200f6b-3942-48a0-b3e4-16dd7eec5fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1223729658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cf85bc-c62d-4af2-83b9-991d96abe227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50cd1917e784475487ab31c7cd6d2f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:12Z,use_quota=True,user_id='ee6524e52faf442fb5cd98f826b29b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d0ad76-8efc-49c2-84d1-1cda4155fe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d0ad76-8efc-49c2-84d1-1cda4155fe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e65d240-02d1-4e38-97cb-c363ff90d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e65d240-02d1-4e38-97cb-c363ff90d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2cf85bc-c62d-4af2-83b9-991d96abe227', 'volume_name': 'volume-a2cf85bc-c62d-4af2-83b9-991d96abe227', 'volume_size': 2}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b52d63-48f6-465d-952b-79b1af5ebe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b52d63-48f6-465d-952b-79b1af5ebe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12287845-a027-488f-8443-8a53fc58f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:13 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Volume a2cf85bc-c62d-4af2-83b9-991d96abe227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2cf85bc-c62d-4af2-83b9-991d96abe227', 'volume_size': 2}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1223729658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cf85bc-c62d-4af2-83b9-991d96abe227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50cd1917e784475487ab31c7cd6d2f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:12Z,use_quota=True,user_id='ee6524e52faf442fb5cd98f826b29b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Creating volume a2cf85bc-c62d-4af2-83b9-991d96abe227 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:23:13 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 2147483648 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:13 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=44, name=volume-a2cf85bc-c62d-4af2-83b9-991d96abe227, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 2147483648" returned: 0 in 0.865s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227" returned: 0 in 0.149s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:14 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] <== create_volume: return (1098ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:23:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12287845-a027-488f-8443-8a53fc58f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2cf85bc-c62d-4af2-83b9-991d96abe227', 'volume_size': 2}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684e5465-079d-46bd-943f-323c9657df05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:14 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Volume volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 (a2cf85bc-c62d-4af2-83b9-991d96abe227): created successfully
Sep 17 15:23:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684e5465-079d-46bd-943f-323c9657df05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Flow 'volume_create_manager' (30845ed8-3d39-4308-b755-6c3bd3f0ec37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:14 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-01e663f1-cb22-4883-aac1-e2d3089a2118 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Created volume successfully.
Sep 17 15:23:15 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Creating offline snapshot 8a922d05-4789-4db4-b390-bc04033902d3 of volume a2cf85bc-c62d-4af2-83b9-991d96abe227 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:23:15 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e7e816-310e-471f-b176-ff14b9534da9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227" returned: 0 in 0.650s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 2G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:16 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=45, name=volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 2G" returned: 0 in 0.252s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "qemu-img rebase -u -b volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3" returned: 0 in 0.283s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3" returned: 0 in 0.172s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3" returned: 0 in 0.207s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.info" returned: 0 in 0.112s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.info" returned: 0 in 0.137s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:18 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-8b942191-4de0-404c-ac4b-ecfcc6aa7b5b tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Create snapshot completed successfully
Sep 17 15:23:18 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Flow 'volume_create_manager' (5719e9f7-ee9e-413c-90cd-81a57b80705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe3f0a0-8576-49fc-9e69-ea1be86dfa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe3f0a0-8576-49fc-9e69-ea1be86dfa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1547621689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c533d663-8a84-4f67-93c7-d21cc301dd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb4aa24c4914e938f4d8bb18c71006a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:18Z,use_quota=True,user_id='4e31161952e44ed396d55c406062b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971b79d2-b8b6-4493-8afb-fba8fa62b225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971b79d2-b8b6-4493-8afb-fba8fa62b225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b390ae-98d2-4185-8ad8-a57ff23cef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b390ae-98d2-4185-8ad8-a57ff23cef95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c533d663-8a84-4f67-93c7-d21cc301dd5c', 'volume_name': 'volume-c533d663-8a84-4f67-93c7-d21cc301dd5c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124c7022-a3c5-4372-ace4-2dd0c167e853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124c7022-a3c5-4372-ace4-2dd0c167e853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb07ebbe-503c-41f2-b359-8c1c08c8adb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:18 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Volume c533d663-8a84-4f67-93c7-d21cc301dd5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c533d663-8a84-4f67-93c7-d21cc301dd5c', 'volume_size': 1}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1547621689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c533d663-8a84-4f67-93c7-d21cc301dd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb4aa24c4914e938f4d8bb18c71006a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:18Z,use_quota=True,user_id='4e31161952e44ed396d55c406062b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Creating volume c533d663-8a84-4f67-93c7-d21cc301dd5c {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:23:18 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:23:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c533d663-8a84-4f67-93c7-d21cc301dd5c 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:18 devstack quobyte-client[83236]: System call of process 91590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:23:18 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=47, name=volume-c533d663-8a84-4f67-93c7-d21cc301dd5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c533d663-8a84-4f67-93c7-d21cc301dd5c 1073741824" returned: 0 in 0.430s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c533d663-8a84-4f67-93c7-d21cc301dd5c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c533d663-8a84-4f67-93c7-d21cc301dd5c" returned: 0 in 0.106s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] <== create_volume: return (641ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:23:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Acquiring lock "cinder-8a922d05-4789-4db4-b390-bc04033902d3-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb07ebbe-503c-41f2-b359-8c1c08c8adb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c533d663-8a84-4f67-93c7-d21cc301dd5c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a34c48-8dba-4323-b6c1-09c415632961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:20 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Volume volume-c533d663-8a84-4f67-93c7-d21cc301dd5c (c533d663-8a84-4f67-93c7-d21cc301dd5c): created successfully
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a34c48-8dba-4323-b6c1-09c415632961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Flow 'volume_create_manager' (5719e9f7-ee9e-413c-90cd-81a57b80705f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2b4c82ac-c4a5-4708-99af-59bfb50f9c7d tempest-VolumeQuotasAdminTestJSON-931165619 None] Created volume successfully.
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-8a922d05-4789-4db4-b390-bc04033902d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.493s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:20 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Acquiring lock "cinder-quobyte-a2cf85bc-c62d-4af2-83b9-991d96abe227" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-quobyte-a2cf85bc-c62d-4af2-83b9-991d96abe227" acquired by "delete_snapshot" :: waited 0.084s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Acquiring lock "cinder-quobyte-8a922d05-4789-4db4-b390-bc04033902d3" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-quobyte-8a922d05-4789-4db4-b390-bc04033902d3" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Deleting offline snapshot 8a922d05-4789-4db4-b390-bc04033902d3 of volume a2cf85bc-c62d-4af2-83b9-991d96abe227 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] snapshot_file for this snap is: volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[609fbf14-a4ed-4d1a-a0a4-d9194c3b56a6]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Acquiring lock "cinder-c533d663-8a84-4f67-93c7-d21cc301dd5c-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "cinder-c533d663-8a84-4f67-93c7-d21cc301dd5c-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:21 devstack quobyte-client[83236]: System call of process 91596 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:23:21 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Acquiring lock "cinder-quobyte-c533d663-8a84-4f67-93c7-d21cc301dd5c" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "cinder-quobyte-c533d663-8a84-4f67-93c7-d21cc301dd5c" acquired by "delete_volume" :: waited 0.019s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3" returned: 0 in 0.890s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2cf85bc-c62d-4af2-83b9-991d96abe227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97b54c7-5a48-4730-8926-0cd347e571dd]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1a66ac-cc15-4909-90bb-205622bb3b63]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c533d663-8a84-4f67-93c7-d21cc301dd5c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c533d663-8a84-4f67-93c7-d21cc301dd5c" returned: 0 in 0.828s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c533d663-8a84-4f67-93c7-d21cc301dd5c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c533d663-8a84-4f67-93c7-d21cc301dd5c" returned: 0 in 0.198s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:22 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "cinder-quobyte-c533d663-8a84-4f67-93c7-d21cc301dd5c" released by "delete_volume" :: held 1.329s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227" returned: 0 in 1.452s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:23 devstack quobyte-client[83236]: System call of process 91607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:23:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3" returned: 0 in 0.580s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:23 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Created reservations ['05bf230f-41d7-4b47-9eff-6ead9a6779fb', 'e96b1683-d206-4f63-aa89-a461d6a1e788', '13bf55c8-f2f9-4b46-ae8a-6236bab9cf4a', '2ed6c9e6-96dc-49d4-a2d5-a73bcd09eaf8'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227.8a922d05-4789-4db4-b390-bc04033902d3" returned: 0 in 0.286s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:23 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-quobyte-8a922d05-4789-4db4-b390-bc04033902d3" released by "_delete_snapshot" :: held 3.541s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:23 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-quobyte-a2cf85bc-c62d-4af2-83b9-991d96abe227" released by "delete_snapshot" :: held 3.616s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.167s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:24 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Deleted volume successfully.
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Created reservations ['37aa2d05-0da4-4051-8ea4-670d257d36a6', '1e560e4b-748e-4858-99c5-9acdb7c48f09', '68408866-a40d-48a6-8d55-649a4ad4d8f2', '53f10ad7-3aa4-4a38-9808-8d57f102621b'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5042654e-0279-4f94-a646-478a595834f7 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "cinder-c533d663-8a84-4f67-93c7-d21cc301dd5c-delete_volume" released by "delete_volume" :: held 3.539s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:24 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Delete snapshot completed successfully.
Sep 17 15:23:24 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3cd620db-d2b5-4e7b-9b52-de3df740349d tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-8a922d05-4789-4db4-b390-bc04033902d3-delete_snapshot" released by "delete_snapshot" :: held 4.552s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Acquiring lock "cinder-a2cf85bc-c62d-4af2-83b9-991d96abe227-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-a2cf85bc-c62d-4af2-83b9-991d96abe227-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:25 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Flow 'volume_create_manager' (ed9ff595-c43c-43f8-ae0a-014a3b5d003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3351d060-3a4a-4292-b367-5578763486d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:25 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Acquiring lock "cinder-quobyte-a2cf85bc-c62d-4af2-83b9-991d96abe227" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3351d060-3a4a-4292-b367-5578763486d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-516831096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47172b36-d56b-41d8-8637-260827e5257f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb4aa24c4914e938f4d8bb18c71006a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:25Z,use_quota=True,user_id='4e31161952e44ed396d55c406062b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1189f8d-9487-4eea-895e-cde8cd50ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1189f8d-9487-4eea-895e-cde8cd50ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b299a0f-7c6e-409f-96f0-7885681e9462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b299a0f-7c6e-409f-96f0-7885681e9462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47172b36-d56b-41d8-8637-260827e5257f', 'volume_name': 'volume-47172b36-d56b-41d8-8637-260827e5257f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540b6c0d-5404-4bad-8451-27f96e2bad23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540b6c0d-5404-4bad-8451-27f96e2bad23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d22ae7a-7fc7-47df-a651-324b19822812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Volume 47172b36-d56b-41d8-8637-260827e5257f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47172b36-d56b-41d8-8637-260827e5257f', 'volume_size': 1}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-516831096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47172b36-d56b-41d8-8637-260827e5257f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb4aa24c4914e938f4d8bb18c71006a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:25Z,use_quota=True,user_id='4e31161952e44ed396d55c406062b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Creating volume 47172b36-d56b-41d8-8637-260827e5257f {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:23:25 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-47172b36-d56b-41d8-8637-260827e5257f 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:25 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=48, name=volume-47172b36-d56b-41d8-8637-260827e5257f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-quobyte-a2cf85bc-c62d-4af2-83b9-991d96abe227" acquired by "delete_volume" :: waited 0.252s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4f523a-959e-48e9-b3fd-08e764c65bc1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-47172b36-d56b-41d8-8637-260827e5257f 1073741824" returned: 0 in 0.376s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-47172b36-d56b-41d8-8637-260827e5257f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-47172b36-d56b-41d8-8637-260827e5257f" returned: 0 in 0.151s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] <== create_volume: return (597ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:23:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.609s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d22ae7a-7fc7-47df-a651-324b19822812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47172b36-d56b-41d8-8637-260827e5257f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba781e2b-a3d4-4d62-806f-08a9ecbcc10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:26 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Volume volume-47172b36-d56b-41d8-8637-260827e5257f (47172b36-d56b-41d8-8637-260827e5257f): created successfully
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba781e2b-a3d4-4d62-806f-08a9ecbcc10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Flow 'volume_create_manager' (ed9ff595-c43c-43f8-ae0a-014a3b5d003e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227" returned: 0 in 0.692s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-aadacbe5-9755-4cfa-829d-f007913eb3c6 tempest-VolumeQuotasAdminTestJSON-931165619 None] Created volume successfully.
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2cf85bc-c62d-4af2-83b9-991d96abe227" returned: 0 in 0.299s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-quobyte-a2cf85bc-c62d-4af2-83b9-991d96abe227" released by "delete_volume" :: held 1.158s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Created reservations ['c721e2b5-8c39-4dbc-8fc3-4d77e945a084', '4aaab2ce-0097-4c77-80c6-d3eea4fc2f0b', '0f40303f-3a20-40a1-936d-ceffed20dda4', '5cf82047-8081-4800-a0b2-fd9f89f4f0cf'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.131s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:27 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:27 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Deleted volume successfully.
Sep 17 15:23:27 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f54214d1-2399-4a1e-a92b-058911474943 tempest-VolumesSnapshotNegativeTestJSON-517558741 None] Lock "cinder-a2cf85bc-c62d-4af2-83b9-991d96abe227-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-52d04e18-0f1e-4b07-962a-5295f810bde1 tempest-VolumeQuotasAdminTestJSON-1981248352 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:28 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-52d04e18-0f1e-4b07-962a-5295f810bde1 tempest-VolumeQuotasAdminTestJSON-1981248352 None] Transfer volume completed successfully.
Sep 17 15:23:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Acquiring lock "cinder-47172b36-d56b-41d8-8637-260827e5257f-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Lock "cinder-47172b36-d56b-41d8-8637-260827e5257f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Acquiring lock "cinder-quobyte-47172b36-d56b-41d8-8637-260827e5257f" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Lock "cinder-quobyte-47172b36-d56b-41d8-8637-260827e5257f" acquired by "delete_volume" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:30 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c81ac2-9cd6-4307-935e-6718cb3b0320]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-47172b36-d56b-41d8-8637-260827e5257f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-47172b36-d56b-41d8-8637-260827e5257f" returned: 0 in 0.760s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-47172b36-d56b-41d8-8637-260827e5257f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-47172b36-d56b-41d8-8637-260827e5257f" returned: 0 in 0.180s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Lock "cinder-quobyte-47172b36-d56b-41d8-8637-260827e5257f" released by "delete_volume" :: held 1.194s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Created reservations ['8672ae25-7a09-40ef-ae25-71405a9c6088', '28ed5399-c47e-4cc4-a59b-a2a6e1270e0b', '04a46587-e2eb-4b2d-813c-8f92f862848c', 'f4a8487b-67b0-4e42-826e-ecc36794fc78'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.115s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:32 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:32 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Deleted volume successfully.
Sep 17 15:23:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2349abbb-a1cc-4064-97af-e014c5374087 tempest-VolumeQuotasAdminTestJSON-844551335 None] Lock "cinder-47172b36-d56b-41d8-8637-260827e5257f-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:32 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:32 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (75ff0a18-a53a-4f94-a5ef-1a0c32f502f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49beda6e-bb40-4f04-93a7-8622346b3e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49beda6e-bb40-4f04-93a7-8622346b3e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523279577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1440d859-b801-4d02-9ebc-9ca2cafd63c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:32Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68b0cd5-94d0-40a5-84e4-c0ff95b30874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68b0cd5-94d0-40a5-84e4-c0ff95b30874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f532863-4313-459c-ac7a-ffd5eeff8e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f532863-4313-459c-ac7a-ffd5eeff8e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1440d859-b801-4d02-9ebc-9ca2cafd63c0', 'volume_name': 'volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475e0d6e-e61d-4d9c-bd67-88557890f9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475e0d6e-e61d-4d9c-bd67-88557890f9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9ad81c-9bbc-403f-876e-cea4ca051e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:33 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Volume 1440d859-b801-4d02-9ebc-9ca2cafd63c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0', 'volume_size': 1}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523279577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1440d859-b801-4d02-9ebc-9ca2cafd63c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:32Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Creating volume 1440d859-b801-4d02-9ebc-9ca2cafd63c0 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:23:33 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:23:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:33 devstack quobyte-client[83236]: System call of process 91628 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:23:33 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=49, name=volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0 1073741824" returned: 0 in 1.011s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:35 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (b0b68690-595d-4ffe-94ef-e01eccc6e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332a42d0-7d89-4121-bb63-8512a8c6b3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:35 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (197b230f-1950-46db-a833-46872ed1d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16cb937-84c4-408b-ba0e-bbb60eb4d474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0" returned: 0 in 1.104s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332a42d0-7d89-4121-bb63-8512a8c6b3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821181218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398cb67e-624a-402a-9a99-30bd5318da16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:34Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829914f6-7772-4241-8553-d600bdb97ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829914f6-7772-4241-8553-d600bdb97ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e979fe16-e4cd-4e81-a02a-dfa109eb7b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e979fe16-e4cd-4e81-a02a-dfa109eb7b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398cb67e-624a-402a-9a99-30bd5318da16', 'volume_name': 'volume-398cb67e-624a-402a-9a99-30bd5318da16', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85ad18d-647f-4e16-b0b9-7f33d4c027b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85ad18d-647f-4e16-b0b9-7f33d4c027b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66f1ab8-9334-42de-8a20-48453c3b75f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:35 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Volume 398cb67e-624a-402a-9a99-30bd5318da16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398cb67e-624a-402a-9a99-30bd5318da16', 'volume_size': 1}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] <== create_volume: return (2225ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821181218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398cb67e-624a-402a-9a99-30bd5318da16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:34Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Creating volume 398cb67e-624a-402a-9a99-30bd5318da16 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:23:35 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-398cb67e-624a-402a-9a99-30bd5318da16 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:35 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=50, name=volume-398cb67e-624a-402a-9a99-30bd5318da16, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16cb937-84c4-408b-ba0e-bbb60eb4d474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724424118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12657fdc-d3e4-4a6d-856d-df9e20b50c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:33Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e35e1f4-9bde-41c7-87f1-d73371136344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e35e1f4-9bde-41c7-87f1-d73371136344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1412c915-9201-4994-8139-b7f8d5e189a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1412c915-9201-4994-8139-b7f8d5e189a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12657fdc-d3e4-4a6d-856d-df9e20b50c97', 'volume_name': 'volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737692c9-d78c-434d-894a-d880c44c9831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737692c9-d78c-434d-894a-d880c44c9831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50192655-2714-4ec7-aafb-6d4d19cf3899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:36 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Volume 12657fdc-d3e4-4a6d-856d-df9e20b50c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97', 'volume_size': 1}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9ad81c-9bbc-403f-876e-cea4ca051e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb28796-d0e4-4535-b4f5-35e58292944d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (f4c4dd23-12ec-4d89-a84a-e8a1305b3f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c486df-8e74-497f-946d-942ee4d4c4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (74a7e576-181e-4382-a47e-86cfd6a69bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae3b1da-ed8c-47d4-b7a5-d8a18019425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-398cb67e-624a-402a-9a99-30bd5318da16 1073741824" returned: 0 in 0.968s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-398cb67e-624a-402a-9a99-30bd5318da16 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:36 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Volume volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0 (1440d859-b801-4d02-9ebc-9ca2cafd63c0): created successfully
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb28796-d0e4-4535-b4f5-35e58292944d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (75ff0a18-a53a-4f94-a5ef-1a0c32f502f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c486df-8e74-497f-946d-942ee4d4c4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1367554641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890910d4-dd40-41f7-880e-e597c66a71fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:35Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a0a608-4093-4ea6-897b-a10fd55f9f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a0a608-4093-4ea6-897b-a10fd55f9f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cce7c6a-1547-48a2-b0bc-1e7155ebfbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cce7c6a-1547-48a2-b0bc-1e7155ebfbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890910d4-dd40-41f7-880e-e597c66a71fb', 'volume_name': 'volume-890910d4-dd40-41f7-880e-e597c66a71fb', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc7900f-de2c-4699-8369-0261fb5e8d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc7900f-de2c-4699-8369-0261fb5e8d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc78e10-301a-4473-9d06-0cbe9427b2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:37 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Volume 890910d4-dd40-41f7-880e-e597c66a71fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890910d4-dd40-41f7-880e-e597c66a71fb', 'volume_size': 1}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae3b1da-ed8c-47d4-b7a5-d8a18019425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844166997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:35Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328f3bcb-634b-4a73-b8e0-5de0c047002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328f3bcb-634b-4a73-b8e0-5de0c047002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409094f1-bb82-461e-a4a6-f05e32d6354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409094f1-bb82-461e-a4a6-f05e32d6354f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3', 'volume_name': 'volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3d8872-4382-4ec4-a12c-67f282182510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3d8872-4382-4ec4-a12c-67f282182510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3beeb9b4-7131-4c1e-aa22-d2fea4073e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:37 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Volume 6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3', 'volume_size': 1}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:37 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a1e44192-fe26-4692-a2cf-19561fd7a4c7 tempest-CreateVolumesFromImageTest-400371887 None] Created volume successfully.
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-398cb67e-624a-402a-9a99-30bd5318da16" returned: 0 in 0.696s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] <== create_volume: return (1715ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.240s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724424118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12657fdc-d3e4-4a6d-856d-df9e20b50c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:33Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Creating volume 12657fdc-d3e4-4a6d-856d-df9e20b50c97 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:23:37 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:23:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:37 devstack quobyte-client[83236]: System call of process 91639 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:23:37 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=51, name=volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66f1ab8-9334-42de-8a20-48453c3b75f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398cb67e-624a-402a-9a99-30bd5318da16', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cbb959-3aad-498b-896f-9e7b25c0d555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97 1073741824" returned: 0 in 0.758s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:38 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Volume volume-398cb67e-624a-402a-9a99-30bd5318da16 (398cb67e-624a-402a-9a99-30bd5318da16): created successfully
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cbb959-3aad-498b-896f-9e7b25c0d555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (b0b68690-595d-4ffe-94ef-e01eccc6e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97" returned: 0 in 0.520s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] <== create_volume: return (1330ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1367554641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890910d4-dd40-41f7-880e-e597c66a71fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:35Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Creating volume 890910d4-dd40-41f7-880e-e597c66a71fb {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:23:38 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:23:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-890910d4-dd40-41f7-880e-e597c66a71fb 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:38 devstack quobyte-client[83236]: System call of process 91644 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:23:38 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=52, name=volume-890910d4-dd40-41f7-880e-e597c66a71fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-bd6a6242-5a32-4489-96a8-a8ed4f254975 tempest-CreateVolumesFromImageTest-400371887 None] Created volume successfully.
Sep 17 15:23:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50192655-2714-4ec7-aafb-6d4d19cf3899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed982d2d-6ad8-450a-938b-e202b258de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-890910d4-dd40-41f7-880e-e597c66a71fb 1073741824" returned: 0 in 0.649s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-890910d4-dd40-41f7-880e-e597c66a71fb {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:39 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Volume volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97 (12657fdc-d3e4-4a6d-856d-df9e20b50c97): created successfully
Sep 17 15:23:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed982d2d-6ad8-450a-938b-e202b258de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (197b230f-1950-46db-a833-46872ed1d099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:40 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-46a6c6d0-cec0-4d8a-aec4-c5eb320dbdaf tempest-CreateVolumesFromImageTest-400371887 None] Created volume successfully.
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-890910d4-dd40-41f7-880e-e597c66a71fb" returned: 0 in 1.131s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] <== create_volume: return (1851ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.368s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844166997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c246ea325ffe40289c2a8e3198b4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:35Z,use_quota=True,user_id='84b6a4712fce468cb95ef6545599d7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Creating volume 6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:23:40 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:23:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:40 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=53, name=volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc78e10-301a-4473-9d06-0cbe9427b2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890910d4-dd40-41f7-880e-e597c66a71fb', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01aebb59-cd98-42b7-a713-c54972e2118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:41 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Volume volume-890910d4-dd40-41f7-880e-e597c66a71fb (890910d4-dd40-41f7-880e-e597c66a71fb): created successfully
Sep 17 15:23:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01aebb59-cd98-42b7-a713-c54972e2118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (f4c4dd23-12ec-4d89-a84a-e8a1305b3f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3 1073741824" returned: 0 in 0.948s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:41 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e245cdc8-5731-498e-890d-a173f74a1740 tempest-CreateVolumesFromImageTest-400371887 None] Created volume successfully.
Sep 17 15:23:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3" returned: 0 in 0.503s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:42 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] <== create_volume: return (1546ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:23:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3beeb9b4-7131-4c1e-aa22-d2fea4073e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75456893-88d7-456a-9843-49d4dabf6b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:42 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Volume volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3 (6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3): created successfully
Sep 17 15:23:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75456893-88d7-456a-9843-49d4dabf6b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Flow 'volume_create_manager' (74a7e576-181e-4382-a47e-86cfd6a69bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-76e1b5a2-72f9-4d68-99d7-cccb083fee37 tempest-CreateVolumesFromImageTest-400371887 None] Created volume successfully.
Sep 17 15:23:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-890910d4-dd40-41f7-880e-e597c66a71fb-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-890910d4-dd40-41f7-880e-e597c66a71fb-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:44 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-quobyte-890910d4-dd40-41f7-880e-e597c66a71fb" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-890910d4-dd40-41f7-880e-e597c66a71fb" acquired by "delete_volume" :: waited 0.016s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:44 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1b9ac0-5d70-40ba-bca7-23625a1754bf]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-890910d4-dd40-41f7-880e-e597c66a71fb {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-890910d4-dd40-41f7-880e-e597c66a71fb" returned: 0 in 0.702s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-890910d4-dd40-41f7-880e-e597c66a71fb {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-890910d4-dd40-41f7-880e-e597c66a71fb" returned: 0 in 0.166s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-890910d4-dd40-41f7-880e-e597c66a71fb" released by "delete_volume" :: held 1.183s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Created reservations ['0515191a-86f4-4612-bf78-d6b2484bbb92', '6cb91502-c254-4fb7-9488-e7b8a3fb83ba', 'd01b8d9e-f041-4e7a-85c0-b3d2673053dc', '9b5c7740-eeb7-4643-b0f3-a61a73879977'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.135s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:45 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Deleted volume successfully.
Sep 17 15:23:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Flow 'volume_create_manager' (fc5a28d9-e7eb-4c87-b4c0-2ecdc1f4abce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ea0e9d-8989-4c17-9976-48ea7140e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b20b6abb-ef9b-45c5-92d3-5665d533ad88 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-890910d4-dd40-41f7-880e-e597c66a71fb-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ea0e9d-8989-4c17-9976-48ea7140e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-279757518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e734cff2-3d72-4d35-a19c-c1da8fc97bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95504616977a42219d45a4cd3a108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:46Z,use_quota=True,user_id='f4ca22fc044146a185f216163ec82b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a586f67-0b88-46f4-8224-70b615656a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a586f67-0b88-46f4-8224-70b615656a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770412d5-4b7d-4d5c-96f6-3156fa855eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770412d5-4b7d-4d5c-96f6-3156fa855eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e734cff2-3d72-4d35-a19c-c1da8fc97bb9', 'volume_name': 'volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a34fe5-7914-4bc2-99e8-d2302ee5ac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a34fe5-7914-4bc2-99e8-d2302ee5ac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d53abc5-25db-4173-9284-262f547e0210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:46 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Volume e734cff2-3d72-4d35-a19c-c1da8fc97bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9', 'volume_size': 1}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-279757518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e734cff2-3d72-4d35-a19c-c1da8fc97bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95504616977a42219d45a4cd3a108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:23:46Z,use_quota=True,user_id='f4ca22fc044146a185f216163ec82b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Creating volume e734cff2-3d72-4d35-a19c-c1da8fc97bb9 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:23:46 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:46 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=54, name=volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3-delete_volume" acquired by "delete_volume" :: waited 0.304s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9 1073741824" returned: 0 in 0.379s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9" returned: 0 in 0.263s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] <== create_volume: return (674ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-quobyte-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d53abc5-25db-4173-9284-262f547e0210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9b9f6c-99ee-4dca-8121-80749582b5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:23:47 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Volume volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9 (e734cff2-3d72-4d35-a19c-c1da8fc97bb9): created successfully
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9b9f6c-99ee-4dca-8121-80749582b5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Flow 'volume_create_manager' (fc5a28d9-e7eb-4c87-b4c0-2ecdc1f4abce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3" acquired by "delete_volume" :: waited 0.142s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4333257f-7a23-4cdd-afba-23e0187d7fd2]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:47 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ece0869e-2255-452b-8457-e02ed9f82b5f tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Created volume successfully.
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3" returned: 0 in 0.490s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3" returned: 0 in 0.126s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3" released by "delete_volume" :: held 0.852s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Created reservations ['39c66c53-f5e5-4bea-94e3-6167f7e41d81', '0ba107ad-b5f6-4e7d-a8ed-55dcc8853212', 'fbe6ac5e-be2b-4841-b0f8-e16919f63ad7', 'ed383dac-21d2-4bfe-a215-f7e0e8c8e51f'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.113s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Deleted volume successfully.
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-85cce4ed-80e6-40f8-b7f3-0201152a8048 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-6c785ef0-666a-4b96-ac3a-fc45a6ce4ae3-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Acquiring lock "cinder-e734cff2-3d72-4d35-a19c-c1da8fc97bb9-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "cinder-e734cff2-3d72-4d35-a19c-c1da8fc97bb9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Acquiring lock "cinder-quobyte-e734cff2-3d72-4d35-a19c-c1da8fc97bb9" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "cinder-quobyte-e734cff2-3d72-4d35-a19c-c1da8fc97bb9" acquired by "delete_volume" :: waited 0.016s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-398cb67e-624a-402a-9a99-30bd5318da16-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-398cb67e-624a-402a-9a99-30bd5318da16-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c8b16-f589-40fc-875c-faba23c0a68d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:50 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-quobyte-398cb67e-624a-402a-9a99-30bd5318da16" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-398cb67e-624a-402a-9a99-30bd5318da16" acquired by "delete_volume" :: waited 0.063s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:50 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[850d535f-7e4a-4670-8df1-42f950e28350]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-398cb67e-624a-402a-9a99-30bd5318da16 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9" returned: 0 in 0.605s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e734cff2-3d72-4d35-a19c-c1da8fc97bb9" returned: 0 in 0.141s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "cinder-quobyte-e734cff2-3d72-4d35-a19c-c1da8fc97bb9" released by "delete_volume" :: held 1.169s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-398cb67e-624a-402a-9a99-30bd5318da16" returned: 0 in 0.849s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-398cb67e-624a-402a-9a99-30bd5318da16 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-398cb67e-624a-402a-9a99-30bd5318da16" returned: 0 in 0.272s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-398cb67e-624a-402a-9a99-30bd5318da16" released by "delete_volume" :: held 1.303s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Created reservations ['9ab74be1-ca72-4f52-9184-75081681426a', '9fb51f1e-b2e0-4081-ac01-f4c2b05aeee4', '68a207df-919a-484f-9612-9f00f15bd050', '3d2f0740-6535-412a-a8a1-828639110f4d'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Created reservations ['e918f464-4f44-490d-a02c-702749cc3a75', '20f45320-d3ab-4730-bdf8-efa91a148a06', '5811707e-402b-4b1a-94f8-681117306aa8', 'acf8746d-5818-4ab5-b498-a89d7f815df0'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-12657fdc-d3e4-4a6d-856d-df9e20b50c97-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-12657fdc-d3e4-4a6d-856d-df9e20b50c97-delete_volume" acquired by "delete_volume" :: waited 0.341s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 1.036s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:53 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.495s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:53 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:53 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Deleted volume successfully.
Sep 17 15:23:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-quobyte-12657fdc-d3e4-4a6d-856d-df9e20b50c97" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4ef2d8a5-345c-4689-9e25-43fa2ebf1e62 tempest-VolumeQuotasNegativeTestJSON-1165072321 None] Lock "cinder-e734cff2-3d72-4d35-a19c-c1da8fc97bb9-delete_volume" released by "delete_volume" :: held 3.493s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-12657fdc-d3e4-4a6d-856d-df9e20b50c97" acquired by "delete_volume" :: waited 0.042s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:53 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[714ef2db-a8c3-4368-88b9-fb6246a33faf]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:53 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Deleted volume successfully.
Sep 17 15:23:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8d39360e-fd88-4c78-a4e1-b1eb8870cb41 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-398cb67e-624a-402a-9a99-30bd5318da16-delete_volume" released by "delete_volume" :: held 4.173s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97" returned: 0 in 0.938s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-12657fdc-d3e4-4a6d-856d-df9e20b50c97" returned: 0 in 0.125s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-12657fdc-d3e4-4a6d-856d-df9e20b50c97" released by "delete_volume" :: held 1.208s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:54 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Created reservations ['0da971c2-6f4e-498e-bc4f-3c08f689252d', 'ac26a74f-2d9c-47f7-9004-5d7755615638', 'c03e0226-f890-4632-afc8-01a2382d6c17', 'ad3366dd-8782-4657-8874-8aa4bbe80e19'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.131s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:55 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:55 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Deleted volume successfully.
Sep 17 15:23:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f2024c5c-f916-48f4-828c-876fde11b64c tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-12657fdc-d3e4-4a6d-856d-df9e20b50c97-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-1440d859-b801-4d02-9ebc-9ca2cafd63c0-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-1440d859-b801-4d02-9ebc-9ca2cafd63c0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:56 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:23:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "cinder-quobyte-1440d859-b801-4d02-9ebc-9ca2cafd63c0" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:23:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-1440d859-b801-4d02-9ebc-9ca2cafd63c0" acquired by "delete_volume" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:23:56 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[be09fd03-f1b2-43b5-b688-ff9e19cb4116]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:23:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0" returned: 0 in 0.554s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1440d859-b801-4d02-9ebc-9ca2cafd63c0" returned: 0 in 0.153s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-quobyte-1440d859-b801-4d02-9ebc-9ca2cafd63c0" released by "delete_volume" :: held 0.904s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Created reservations ['f937d63f-0668-49f2-8cc4-5765957c96dd', 'ab969e1c-b570-4c67-b4c2-680af5634afa', '90fff98b-f2cc-4502-ae9d-b0c7f9c421fd', '957fdb86-5d81-4ab0-9b58-f2f9178fcef4'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:23:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:23:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.123s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:23:58 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:23:58 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Deleted volume successfully.
Sep 17 15:23:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9c8b06cd-e077-4a0e-93ad-721bc53cc176 tempest-CreateVolumesFromImageTest-400371887 None] Lock "cinder-1440d859-b801-4d02-9ebc-9ca2cafd63c0-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:01 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=84,cinder:UPDATE=120,cinder:DELETE=9,cinder:INSERT=27 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:24:01 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=72,cinder:INSERT=22,cinder:UPDATE=117,cinder:DELETE=13 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:24:01 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:01 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (70b0dad5-223f-4a03-b916-d223d1047718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bca589e-4cb5-4a2d-a4d5-b9adaedcf5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bca589e-4cb5-4a2d-a4d5-b9adaedcf5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767066637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f068671-fa63-408e-af24-9af11e2331b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:02Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591b4730-527c-4424-bc01-f548789e9e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591b4730-527c-4424-bc01-f548789e9e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fc2846-7902-4f49-aa31-52a9c5f3e482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fc2846-7902-4f49-aa31-52a9c5f3e482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f068671-fa63-408e-af24-9af11e2331b7', 'volume_name': 'volume-0f068671-fa63-408e-af24-9af11e2331b7', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89376ed7-8db2-4afb-9e03-eeb149d77f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89376ed7-8db2-4afb-9e03-eeb149d77f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cb8840-4303-46c8-885f-5176f20aefc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:02 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume 0f068671-fa63-408e-af24-9af11e2331b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f068671-fa63-408e-af24-9af11e2331b7', 'volume_size': 1}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767066637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f068671-fa63-408e-af24-9af11e2331b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:02Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Creating volume 0f068671-fa63-408e-af24-9af11e2331b7 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:02 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:02 devstack quobyte-client[83236]: System call of process 91725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:02 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=55, name=volume-0f068671-fa63-408e-af24-9af11e2331b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 1073741824" returned: 0 in 0.366s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7" returned: 0 in 0.095s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] <== create_volume: return (540ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.553s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cb8840-4303-46c8-885f-5176f20aefc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f068671-fa63-408e-af24-9af11e2331b7', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61d6468-e797-4d21-9e1f-1878dc61f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:02 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume volume-0f068671-fa63-408e-af24-9af11e2331b7 (0f068671-fa63-408e-af24-9af11e2331b7): created successfully
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61d6468-e797-4d21-9e1f-1878dc61f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (70b0dad5-223f-4a03-b916-d223d1047718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e06f15a2-bd2d-46ea-aa75-bc73c4147326 tempest-CreateVolumesFromSnapshotTest-425674486 None] Created volume successfully.
Sep 17 15:24:04 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Creating offline snapshot 36acc307-92c9-482e-bb8d-21019d172472 of volume 0f068671-fa63-408e-af24-9af11e2331b7 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:24:04 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb53e099-61d0-4465-89fa-f40ed45dfa73]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7" returned: 0 in 0.460s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:05 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=56, name=volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 1G" returned: 0 in 0.242s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0f068671-fa63-408e-af24-9af11e2331b7 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "qemu-img rebase -u -b volume-0f068671-fa63-408e-af24-9af11e2331b7 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472" returned: 0 in 0.204s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472" returned: 0 in 0.126s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472" returned: 0 in 0.155s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.info" returned: 0 in 0.130s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:24:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.info" returned: 0 in 0.199s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:06 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-fa99bdc9-75e5-40e0-964a-995c9df1d386 tempest-CreateVolumesFromSnapshotTest-425674486 None] Create snapshot completed successfully
Sep 17 15:24:08 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (797ce04e-a922-4f0e-a01c-2a544c667f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bb774e-ce15-4bf2-818e-1d70234e00fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bb774e-ce15-4bf2-818e-1d70234e00fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98964222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912bdd32-de7d-4bd6-abdb-9767f39a53f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:08Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419cd982-223b-45ae-8047-6a8cca529b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419cd982-223b-45ae-8047-6a8cca529b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e322dd00-b70c-4de7-9c45-2a2d8803f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e322dd00-b70c-4de7-9c45-2a2d8803f675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912bdd32-de7d-4bd6-abdb-9767f39a53f7', 'volume_name': 'volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af1aaea-caf9-42ae-9692-0a31ec3ad6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af1aaea-caf9-42ae-9692-0a31ec3ad6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4fdbd1-fdd9-4ce4-9917-20b2a69bbcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:08 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume 912bdd32-de7d-4bd6-abdb-9767f39a53f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7', 'volume_size': 1}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98964222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912bdd32-de7d-4bd6-abdb-9767f39a53f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:08Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Creating volume 912bdd32-de7d-4bd6-abdb-9767f39a53f7 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:08 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:08 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=58, name=volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7 1073741824" returned: 0 in 0.919s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7" returned: 0 in 0.474s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] <== create_volume: return (1451ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:09 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:09 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (b3d0f96b-78aa-4432-ba78-f6186d4192bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369753a6-34ac-454a-8a0a-5bf813cda685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:10 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (d864d8c2-82d1-46fb-9151-2307431e52bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ffa8a6-a260-46fb-8ca0-97a98ed2eae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369753a6-34ac-454a-8a0a-5bf813cda685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1149221916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:09Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547d7b2b-fbea-4577-8b13-224806265135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547d7b2b-fbea-4577-8b13-224806265135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764e9d99-3aa9-4d2f-ad1f-197e51ec4958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764e9d99-3aa9-4d2f-ad1f-197e51ec4958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8', 'volume_name': 'volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a155489c-046e-4659-aff2-0aea1d3a6775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a155489c-046e-4659-aff2-0aea1d3a6775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c0ced1-f9d1-4b9a-8c39-1db104ee3028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:10 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume 8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8', 'volume_size': 1}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1149221916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:09Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Creating volume 8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:10 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:10 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=59, name=volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4fdbd1-fdd9-4ce4-9917-20b2a69bbcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21dd6f5-23eb-45e9-b813-dc84c7584d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:11 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7 (912bdd32-de7d-4bd6-abdb-9767f39a53f7): created successfully
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21dd6f5-23eb-45e9-b813-dc84c7584d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (797ce04e-a922-4f0e-a01c-2a544c667f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ffa8a6-a260-46fb-8ca0-97a98ed2eae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2127743000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dff509-4417-4c53-a7c3-0de75a6bf071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:09Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3964b4-33e3-46af-84e6-443626b23fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3964b4-33e3-46af-84e6-443626b23fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05295d06-fa26-4587-b94b-3cb0fa81cfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05295d06-fa26-4587-b94b-3cb0fa81cfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51dff509-4417-4c53-a7c3-0de75a6bf071', 'volume_name': 'volume-51dff509-4417-4c53-a7c3-0de75a6bf071', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f711c6-7cc1-40df-8bfa-01dde3010640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f711c6-7cc1-40df-8bfa-01dde3010640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeb5d14-a04f-45b7-a011-8f4f175b7bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:11 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume 51dff509-4417-4c53-a7c3-0de75a6bf071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51dff509-4417-4c53-a7c3-0de75a6bf071', 'volume_size': 1}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:11 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-808018b8-7e71-4909-acc6-f64f465f2d56 tempest-CreateVolumesFromSnapshotTest-425674486 None] Created volume successfully.
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8 1073741824" returned: 0 in 1.186s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:11 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (fe2eb71e-32f0-4f2b-9d61-d6bf320fc350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019172ae-e9f6-4c57-a033-67c48bde95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019172ae-e9f6-4c57-a033-67c48bde95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2100212872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c821661f-f67b-4cbc-90fe-73fb7eb4f929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:10Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e668bd42-ae69-4fab-bb6e-44a38c98ba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e668bd42-ae69-4fab-bb6e-44a38c98ba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f05fdf-1fef-435e-919f-01d3a12c5124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f05fdf-1fef-435e-919f-01d3a12c5124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c821661f-f67b-4cbc-90fe-73fb7eb4f929', 'volume_name': 'volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92957b96-93b5-47f5-a867-984ca60e4bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92957b96-93b5-47f5-a867-984ca60e4bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0126c89-fd99-4803-945b-68526ff33540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:12 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume c821661f-f67b-4cbc-90fe-73fb7eb4f929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929', 'volume_size': 1}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8" returned: 0 in 1.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] <== create_volume: return (2304ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:12 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (9d016751-f0b7-48a0-b2e6-62b1c2c70590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224d05ef-8cd6-40b5-8000-4542d22d842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2127743000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dff509-4417-4c53-a7c3-0de75a6bf071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:09Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Creating volume 51dff509-4417-4c53-a7c3-0de75a6bf071 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:12 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51dff509-4417-4c53-a7c3-0de75a6bf071 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:12 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=60, name=volume-51dff509-4417-4c53-a7c3-0de75a6bf071, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c0ced1-f9d1-4b9a-8c39-1db104ee3028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e822b4-62b3-4ec5-9d1b-e91b98497c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 1.286s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224d05ef-8cd6-40b5-8000-4542d22d842e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531340959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93f511a-f612-4f9d-8b43-0fcbc72961ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:11Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94a7ca1-ca78-4132-9e53-72008aed4d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94a7ca1-ca78-4132-9e53-72008aed4d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0ec3d6-a7cb-4caa-9910-66b424237486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0ec3d6-a7cb-4caa-9910-66b424237486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93f511a-f612-4f9d-8b43-0fcbc72961ba', 'volume_name': 'volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab29abe3-a1e6-4618-bb9e-91618caf88ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab29abe3-a1e6-4618-bb9e-91618caf88ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9996bf-a373-4497-825d-80d3b676b8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:13 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume d93f511a-f612-4f9d-8b43-0fcbc72961ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba', 'volume_size': 1}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:13 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8 (8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8): created successfully
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e822b4-62b3-4ec5-9d1b-e91b98497c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (b3d0f96b-78aa-4432-ba78-f6186d4192bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51dff509-4417-4c53-a7c3-0de75a6bf071 1073741824" returned: 0 in 0.800s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51dff509-4417-4c53-a7c3-0de75a6bf071 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:13 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a618a2ca-9f1e-450c-8299-c40316cf0e7f tempest-CreateVolumesFromSnapshotTest-425674486 None] Created volume successfully.
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51dff509-4417-4c53-a7c3-0de75a6bf071" returned: 0 in 0.350s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] <== create_volume: return (1171ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2100212872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c821661f-f67b-4cbc-90fe-73fb7eb4f929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:10Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Creating volume c821661f-f67b-4cbc-90fe-73fb7eb4f929 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:13 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:14 devstack quobyte-client[83236]: System call of process 91803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:14 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=61, name=volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeb5d14-a04f-45b7-a011-8f4f175b7bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51dff509-4417-4c53-a7c3-0de75a6bf071', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648f44a4-f3f6-4312-ae61-40185e530c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:14 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume volume-51dff509-4417-4c53-a7c3-0de75a6bf071 (51dff509-4417-4c53-a7c3-0de75a6bf071): created successfully
Sep 17 15:24:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648f44a4-f3f6-4312-ae61-40185e530c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (d864d8c2-82d1-46fb-9151-2307431e52bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929 1073741824" returned: 0 in 0.687s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:14 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-113a3041-5dd6-49d3-bd0d-13dac02a2f7a tempest-CreateVolumesFromSnapshotTest-425674486 None] Created volume successfully.
Sep 17 15:24:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:14 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Flow 'volume_create_manager' (a0e8125a-9cc6-42b3-841e-9e374a7bb210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a28659-3947-4bd7-81e5-9b0bd80aac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929" returned: 0 in 0.420s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] <== create_volume: return (1176ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531340959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93f511a-f612-4f9d-8b43-0fcbc72961ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3d9f2bf784433490246397d8dc0da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:11Z,use_quota=True,user_id='54640b4c66754c65855dbbb77d0ddff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Creating volume d93f511a-f612-4f9d-8b43-0fcbc72961ba {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:15 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a28659-3947-4bd7-81e5-9b0bd80aac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1627172799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c40530-7ac9-4296-80e6-13dea8634d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e88aabbbb70494d92753b346543f3cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:14Z,use_quota=True,user_id='a2e29e8811bd4810bc4452592d7c366e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:15 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=62, name=volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb860da-1a15-4e24-ba20-249b935c03a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb860da-1a15-4e24-ba20-249b935c03a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1ed279-eeb4-4707-8315-a0c61501a7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.image.glance [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Creating Keystone auth plugin from conf {{(pid=83214) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0126c89-fd99-4803-945b-68526ff33540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7902fd9-8441-4f45-864a-7f36609f755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:15 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929 (c821661f-f67b-4cbc-90fe-73fb7eb4f929): created successfully
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7902fd9-8441-4f45-864a-7f36609f755b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (fe2eb71e-32f0-4f2b-9d61-d6bf320fc350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba 1073741824" returned: 0 in 0.582s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba" returned: 0 in 0.378s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] <== create_volume: return (996ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:16 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-525a408e-49c9-4727-81f1-a9046dd4caa8 tempest-CreateVolumesFromSnapshotTest-425674486 None] Created volume successfully.
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9996bf-a373-4497-825d-80d3b676b8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cd73c7-5832-4f84-b8e9-6a16a7729144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:16 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba (d93f511a-f612-4f9d-8b43-0fcbc72961ba): created successfully
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cd73c7-5832-4f84-b8e9-6a16a7729144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Flow 'volume_create_manager' (9d016751-f0b7-48a0-b2e6-62b1c2c70590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:16 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3a44e48f-4724-4d65-bb4e-d815db1cd620 tempest-CreateVolumesFromSnapshotTest-425674486 None] Created volume successfully.
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1ed279-eeb4-4707-8315-a0c61501a7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1c40530-7ac9-4296-80e6-13dea8634d36', 'volume_name': 'volume-a1c40530-7ac9-4296-80e6-13dea8634d36', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a90258a0>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5924515a-7297-443c-9bc0-8077226444a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5924515a-7297-443c-9bc0-8077226444a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f042ea-7f20-480f-8835-79d52c3e6969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:16 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Volume a1c40530-7ac9-4296-80e6-13dea8634d36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1c40530-7ac9-4296-80e6-13dea8634d36', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a90258a0>}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Cloning a1c40530-7ac9-4296-80e6-13dea8634d36 from image 1365088a-6d64-46d1-8e72-c667035bafb6  at location (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]). {{(pid=83214) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 15:24:16 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 15:24:16 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6870c44-b6cb-4875-bd0c-f082916069b0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:17 devstack sudo[91813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD
Sep 17 15:24:17 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:24:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-d93f511a-f612-4f9d-8b43-0fcbc72961ba-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-d93f511a-f612-4f9d-8b43-0fcbc72961ba-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:18 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-quobyte-d93f511a-f612-4f9d-8b43-0fcbc72961ba" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-d93f511a-f612-4f9d-8b43-0fcbc72961ba" acquired by "delete_volume" :: waited 0.021s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:18 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[7160a369-7ef6-4473-a4f3-1acb85acc41b]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:18 devstack quobyte-client[83236]: System call of process 91815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba" returned: 0 in 0.740s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d93f511a-f612-4f9d-8b43-0fcbc72961ba" returned: 0 in 0.259s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-d93f511a-f612-4f9d-8b43-0fcbc72961ba" released by "delete_volume" :: held 1.275s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:19 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root
Sep 17 15:24:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD" returned: 0 in 2.768s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:19 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Temporary image 1365088a-6d64-46d1-8e72-c667035bafb6 is fetched for user a2e29e8811bd4810bc4452592d7c366e. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 15:24:19 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Created reservations ['20766703-5fdf-4515-aa90-5323dd09aeb6', '731672f4-906c-4b58-9827-61eb94960f81', 'ccba67df-e2fa-4603-b2d9-8aa08613edfc', 'f34a7f72-fabb-4d4d-af24-33db9bdf5cc1'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a37202e-386c-4f91-b203-88709c56ec61]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.121s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:24:20 devstack sudo[91822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD
Sep 17 15:24:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Deleted volume successfully.
Sep 17 15:24:20 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:24:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-628c5616-b7f2-4acf-b2cc-7fb5442b60f7 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-d93f511a-f612-4f9d-8b43-0fcbc72961ba-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-c821661f-f67b-4cbc-90fe-73fb7eb4f929-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-c821661f-f67b-4cbc-90fe-73fb7eb4f929-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:21 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-quobyte-c821661f-f67b-4cbc-90fe-73fb7eb4f929" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-c821661f-f67b-4cbc-90fe-73fb7eb4f929" acquired by "delete_volume" :: waited 0.015s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:21 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a50cb53-5a9b-425d-87b6-660d1908e482]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929" returned: 0 in 0.495s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c821661f-f67b-4cbc-90fe-73fb7eb4f929" returned: 0 in 0.154s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:22 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-c821661f-f67b-4cbc-90fe-73fb7eb4f929" released by "delete_volume" :: held 0.957s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:22 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Created reservations ['865d1611-a79f-42ea-922d-58f9986991d0', 'a3edab32-ffdc-43ee-8dea-6d35e95e5d7e', '41da76ce-b6b2-4cc7-8bea-30289e09a396', '009a3600-f6e7-42da-9b03-d4d6207c9668'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:24:22 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root
Sep 17 15:24:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD" returned: 0 in 2.955s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1627172799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c40530-7ac9-4296-80e6-13dea8634d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e88aabbbb70494d92753b346543f3cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:14Z,use_quota=True,user_id='a2e29e8811bd4810bc4452592d7c366e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Creating volume a1c40530-7ac9-4296-80e6-13dea8634d36 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:23 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:23 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=63, name=volume-a1c40530-7ac9-4296-80e6-13dea8634d36, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 1073741824" returned: 0 in 0.947s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8-delete_volume" acquired by "delete_volume" :: waited 0.426s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.970s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:24:24 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Deleted volume successfully.
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36" returned: 0 in 0.611s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] <== create_volume: return (1617ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:24 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-quobyte-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2180e74c-5d87-457d-bc8d-67171b5cdf8f tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-c821661f-f67b-4cbc-90fe-73fb7eb4f929-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:24 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Flow 'volume_create_manager' (c8dc4a26-f187-405b-9751-de8021224ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa8e8d3-d49d-4039-ba09-963b6f39c24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Attempting download of 1365088a-6d64-46d1-8e72-c667035bafb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}])) to volume a1c40530-7ac9-4296-80e6-13dea8634d36. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8" acquired by "delete_volume" :: waited 0.165s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa8e8d3-d49d-4039-ba09-963b6f39c24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-976137199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c89138-71d1-4447-a00f-da0fa5d0ed24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae4d930601486bbc3c3eea7b8c73f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:24Z,use_quota=True,user_id='8ae81cfe2d564bfeb3433170ae0c8353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da3117e-4bbe-45bd-a00b-bf959479aab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da3117e-4bbe-45bd-a00b-bf959479aab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db0702a-8ca6-4243-be36-ab323a414333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db0702a-8ca6-4243-be36-ab323a414333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c89138-71d1-4447-a00f-da0fa5d0ed24', 'volume_name': 'volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901f5fc4-9887-4591-89b2-8834b77dc3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901f5fc4-9887-4591-89b2-8834b77dc3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b987bd59-6b7a-4880-a0ac-7e967c880f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:24 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Volume b2c89138-71d1-4447-a00f-da0fa5d0ed24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24', 'volume_size': 1}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-976137199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c89138-71d1-4447-a00f-da0fa5d0ed24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae4d930601486bbc3c3eea7b8c73f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:24Z,use_quota=True,user_id='8ae81cfe2d564bfeb3433170ae0c8353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Creating volume b2c89138-71d1-4447-a00f-da0fa5d0ed24 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:24 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:25 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=64, name=volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:25 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0869c8b9-ae22-433e-8be0-8eec24aaf219]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:25 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c879b6-0369-4c35-b2e8-a7afd4a47031]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6__sayzhxa {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24 1073741824" returned: 0 in 0.711s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24" returned: 0 in 0.189s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] <== create_volume: return (1019ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8" returned: 0 in 0.937s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b987bd59-6b7a-4880-a0ac-7e967c880f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dce04d-378b-42a2-81e7-953d80d99ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8" returned: 0 in 0.412s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6__sayzhxa" returned: 0 in 1.035s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:26 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Volume volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24 (b2c89138-71d1-4447-a00f-da0fa5d0ed24): created successfully
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dce04d-378b-42a2-81e7-953d80d99ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Flow 'volume_create_manager' (c8dc4a26-f187-405b-9751-de8021224ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6__sayzhxa {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-395b0bec-966f-4de4-ac69-13bb0f6db9d1 tempest-AttachVolumeTestJSON-570979370 None] Created volume successfully.
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8" released by "delete_volume" :: held 2.129s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Created reservations ['a2f47ad0-43b5-4cbf-927e-5d55886bae10', '9e93272c-b09c-47e0-9c67-e0becf8a3303', '80983c83-9908-4a71-ac02-b32c397915f3', '65a3431d-ab1d-4974-9cb0-84c37dd1c8a5'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6__sayzhxa" returned: 1 in 0.768s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6__sayzhxa' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdc3d2f-739a-4343-af1c-a4d421fe010c]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.222s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:27 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:24:27 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Deleted volume successfully.
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee9f34d5-c0ab-458f-9f1a-0b010bfdb6fc tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-8ee4f1ea-65ef-4305-8e2d-83c923d1c3d8-delete_volume" released by "delete_volume" :: held 3.794s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD" returned: 0 in 0.704s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] 1365088a-6d64-46d1-8e72-c667035bafb6 was qcow2, converting to raw {{(pid=83214) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:28 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=63, name=volume-a1c40530-7ac9-4296-80e6-13dea8634d36, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-51dff509-4417-4c53-a7c3-0de75a6bf071-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-51dff509-4417-4c53-a7c3-0de75a6bf071-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-quobyte-51dff509-4417-4c53-a7c3-0de75a6bf071" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-51dff509-4417-4c53-a7c3-0de75a6bf071" acquired by "delete_volume" :: waited 0.018s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c690c92-a72c-4f8b-a90c-499c6084e4f1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51dff509-4417-4c53-a7c3-0de75a6bf071 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36" returned: 0 in 1.285s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:29 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_x_6jgkgwdevstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:24:29 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Converted 112.00 MB image at 84.15 MB/s
Sep 17 15:24:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:29 devstack quobyte-client[83236]: System call of process 91868 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51dff509-4417-4c53-a7c3-0de75a6bf071" returned: 0 in 0.805s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51dff509-4417-4c53-a7c3-0de75a6bf071 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 1G" returned: 0 in 0.281s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51dff509-4417-4c53-a7c3-0de75a6bf071" returned: 0 in 0.139s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:30 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[de30c57d-f79d-45aa-8b03-8543ef04d79b]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-51dff509-4417-4c53-a7c3-0de75a6bf071" released by "delete_volume" :: held 1.111s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:30 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Created reservations ['84c8d86f-fa28-4877-ab62-ddb5a2a59c65', '52aa49b5-8efe-44a8-930c-636d5e017ce5', 'fd766f46-db66-4378-b1a5-974342eeaacb', 'a1b02f23-48f5-4059-84e3-6937438c2afd'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:24:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36" returned: 0 in 0.708s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36" returned: 1 in 0.817s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Downloaded image 1365088a-6d64-46d1-8e72-c667035bafb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}])) to volume a1c40530-7ac9-4296-80e6-13dea8634d36 successfully. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Temporary image 1365088a-6d64-46d1-8e72-c667035bafb6 for user a2e29e8811bd4810bc4452592d7c366e is deleted. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Marking volume a1c40530-7ac9-4296-80e6-13dea8634d36 as bootable. {{(pid=83214) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-912bdd32-de7d-4bd6-abdb-9767f39a53f7-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:32 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Copying metadata from image 1365088a-6d64-46d1-8e72-c667035bafb6 to a1c40530-7ac9-4296-80e6-13dea8634d36. {{(pid=83214) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 15:24:32 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Creating volume glance metadata for volume a1c40530-7ac9-4296-80e6-13dea8634d36 backed by image 1365088a-6d64-46d1-8e72-c667035bafb6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83214) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 15:24:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.782s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:32 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:24:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-912bdd32-de7d-4bd6-abdb-9767f39a53f7-delete_volume" acquired by "delete_volume" :: waited 0.401s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:32 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Deleted volume successfully.
Sep 17 15:24:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3514d224-e464-4b85-8388-3f88471e7b4e tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-51dff509-4417-4c53-a7c3-0de75a6bf071-delete_volume" released by "delete_volume" :: held 4.364s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-41269090-3ecf-4b2c-8855-196de7110d34 req-0b9308a0-ce9c-4805-a9a3-10c3c248e4c9 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-41269090-3ecf-4b2c-8855-196de7110d34 req-0b9308a0-ce9c-4805-a9a3-10c3c248e4c9 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:33 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-quobyte-912bdd32-de7d-4bd6-abdb-9767f39a53f7" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:33 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dad6931-4a05-41ae-803e-fe4478989ed5]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-41269090-3ecf-4b2c-8855-196de7110d34 req-0b9308a0-ce9c-4805-a9a3-10c3c248e4c9 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-912bdd32-de7d-4bd6-abdb-9767f39a53f7" acquired by "delete_volume" :: waited 0.373s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:33 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dc1c79-d5b6-47d9-8518-e48de9c63901]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-41269090-3ecf-4b2c-8855-196de7110d34 req-0b9308a0-ce9c-4805-a9a3-10c3c248e4c9 tempest-AttachVolumeTestJSON-570979370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24" returned: 0 in 0.947s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-41269090-3ecf-4b2c-8855-196de7110d34 req-0b9308a0-ce9c-4805-a9a3-10c3c248e4c9 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.032s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f042ea-7f20-480f-8835-79d52c3e6969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c40530-7ac9-4296-80e6-13dea8634d36', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a90258a0>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2905064-53c8-4b35-847a-991ead9d1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:34 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Volume volume-a1c40530-7ac9-4296-80e6-13dea8634d36 (a1c40530-7ac9-4296-80e6-13dea8634d36): created successfully
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2905064-53c8-4b35-847a-991ead9d1178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Flow 'volume_create_manager' (a0e8125a-9cc6-42b3-841e-9e374a7bb210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7" returned: 0 in 0.803s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c2c23a30-3150-46d5-8aaf-779db9a383f9 tempest-VolumesImageMetadata-13871505 None] Created volume successfully.
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-41269090-3ecf-4b2c-8855-196de7110d34 req-0b9308a0-ce9c-4805-a9a3-10c3c248e4c9 tempest-AttachVolumeTestJSON-570979370 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f4d3e4f-5de7-4b93-a9f2-288abd399c69', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:24:34 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-41269090-3ecf-4b2c-8855-196de7110d34 req-0b9308a0-ce9c-4805-a9a3-10c3c248e4c9 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-912bdd32-de7d-4bd6-abdb-9767f39a53f7" returned: 0 in 0.382s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-912bdd32-de7d-4bd6-abdb-9767f39a53f7" released by "delete_volume" :: held 1.356s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-41269090-3ecf-4b2c-8855-196de7110d34 req-0b9308a0-ce9c-4805-a9a3-10c3c248e4c9 tempest-AttachVolumeTestJSON-570979370 None] attachment_update completed successfully.
Sep 17 15:24:34 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Created reservations ['f6aa7e50-f7eb-4be1-b2c6-f789030efef8', 'baef8a29-e780-4213-9580-378f60c66335', 'f65e51dc-2d71-4aa6-8673-62376f5c59ed', 'c40d3a1c-e85b-4a3d-ba5b-c8fda30a4acd'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:24:35 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Deleted volume successfully.
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Acquiring lock "cinder-a1c40530-7ac9-4296-80e6-13dea8634d36-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-36acc307-92c9-482e-bb8d-21019d172472-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bfd9d210-8ee5-49ad-96ef-48739f7ead3d tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-912bdd32-de7d-4bd6-abdb-9767f39a53f7-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-36acc307-92c9-482e-bb8d-21019d172472-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:35 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-quobyte-0f068671-fa63-408e-af24-9af11e2331b7" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Lock "cinder-a1c40530-7ac9-4296-80e6-13dea8634d36-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-0f068671-fa63-408e-af24-9af11e2331b7" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-quobyte-36acc307-92c9-482e-bb8d-21019d172472" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-36acc307-92c9-482e-bb8d-21019d172472" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Deleting offline snapshot 36acc307-92c9-482e-bb8d-21019d172472 of volume 0f068671-fa63-408e-af24-9af11e2331b7 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] snapshot_file for this snap is: volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2232435b-b533-4e43-9d93-edfb4e0630a1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:35 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Acquiring lock "cinder-quobyte-a1c40530-7ac9-4296-80e6-13dea8634d36" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Lock "cinder-quobyte-a1c40530-7ac9-4296-80e6-13dea8634d36" acquired by "delete_volume" :: waited 0.227s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb9bc3f-d3c5-4c19-afad-44b334d041f8]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472" returned: 0 in 0.675s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f068671-fa63-408e-af24-9af11e2331b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:24:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c416b6-eb20-4d05-87cf-04fc62e39264]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36" returned: 0 in 0.589s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:37 devstack quobyte-client[83236]: System call of process 91968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:37 devstack quobyte-client[83236]: System call of process 91968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7" returned: 0 in 0.590s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:37 devstack quobyte-client[83236]: System call of process 91970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36" returned: 1 in 0.632s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:24:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472" returned: 0 in 0.368s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a1c40530-7ac9-4296-80e6-13dea8634d36" returned: 0 in 0.216s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7.36acc307-92c9-482e-bb8d-21019d172472" returned: 0 in 0.221s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Lock "cinder-quobyte-a1c40530-7ac9-4296-80e6-13dea8634d36" released by "delete_volume" :: held 1.872s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-36acc307-92c9-482e-bb8d-21019d172472" released by "_delete_snapshot" :: held 2.405s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-0f068671-fa63-408e-af24-9af11e2331b7" released by "delete_snapshot" :: held 2.480s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Created reservations ['b0e66667-7ed2-4985-a885-fc7c7fad72a3', '76924ee4-0ea8-4167-83aa-5f9a28e3b40d', 'e310347e-22b6-4c83-a587-90c5cea4c6bb', '492790e1-fcb2-46e1-8258-aedf91238385'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Created reservations ['9f7e937d-b1a5-4053-8f9e-0b7edd439928', 'e4619c96-493d-4ecc-a18e-924efac2be3c', '73955e47-3b96-4bda-ab66-726941d574aa', 'cb61e641-9021-4f03-bd23-60d871b92c9d'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:38 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Delete snapshot completed successfully.
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.212s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7ffdc8b6-f879-4575-99fa-592ae761cfa6 tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-36acc307-92c9-482e-bb8d-21019d172472-delete_snapshot" released by "delete_snapshot" :: held 3.097s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:38 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Deleted volume successfully.
Sep 17 15:24:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-359e2b58-662d-4115-883e-1c53dc022e64 tempest-VolumesImageMetadata-13871505 None] Lock "cinder-a1c40530-7ac9-4296-80e6-13dea8634d36-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-0f068671-fa63-408e-af24-9af11e2331b7-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-0f068671-fa63-408e-af24-9af11e2331b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "cinder-quobyte-0f068671-fa63-408e-af24-9af11e2331b7" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-0f068671-fa63-408e-af24-9af11e2331b7" acquired by "delete_volume" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:39 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b67a9c7-bfc4-45cc-89ff-ab6c307c7ed3]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7" returned: 0 in 0.454s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0f068671-fa63-408e-af24-9af11e2331b7" returned: 0 in 0.141s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-quobyte-0f068671-fa63-408e-af24-9af11e2331b7" released by "delete_volume" :: held 0.784s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:40 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Created reservations ['ce48d133-d719-4b28-a5f4-2947c6dc367d', '612c7434-04e7-4e69-8c4a-e5086183e3c4', '7c6d214f-4dda-4538-9693-a13a43d3b128', 'b9250434-869f-437d-9512-a45b495e53d0'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:24:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.221s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:41 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:24:41 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Deleted volume successfully.
Sep 17 15:24:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b5bee4ae-11be-4d46-885e-8a03e8d5e87a tempest-CreateVolumesFromSnapshotTest-425674486 None] Lock "cinder-0f068671-fa63-408e-af24-9af11e2331b7-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:43 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Flow 'volume_create_manager' (57f5481d-c502-4daa-a9c6-ef1d5daefe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd823616-69cd-4bf3-959c-aa3cd82e4c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd823616-69cd-4bf3-959c-aa3cd82e4c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-908147331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a045e4c2-fc8b-47e5-94e1-c8aea4ae806c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae4d930601486bbc3c3eea7b8c73f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:43Z,use_quota=True,user_id='8ae81cfe2d564bfeb3433170ae0c8353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a6a87f-c23c-453f-a5a1-ff520af96660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a6a87f-c23c-453f-a5a1-ff520af96660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5262609c-5e79-40c4-8096-19c0b5c121f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5262609c-5e79-40c4-8096-19c0b5c121f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a045e4c2-fc8b-47e5-94e1-c8aea4ae806c', 'volume_name': 'volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c368b7-d7f1-431c-ad41-003f43094be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c368b7-d7f1-431c-ad41-003f43094be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130cdc24-cb34-466c-a5cd-09b29ee95324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:43 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Volume a045e4c2-fc8b-47e5-94e1-c8aea4ae806c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c', 'volume_size': 1}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-908147331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a045e4c2-fc8b-47e5-94e1-c8aea4ae806c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae4d930601486bbc3c3eea7b8c73f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:43Z,use_quota=True,user_id='8ae81cfe2d564bfeb3433170ae0c8353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Creating volume a045e4c2-fc8b-47e5-94e1-c8aea4ae806c {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:43 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:43 devstack quobyte-client[83236]: System call of process 92315 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:43 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=65, name=volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c 1073741824" returned: 0 in 0.462s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c" returned: 0 in 0.174s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130cdc24-cb34-466c-a5cd-09b29ee95324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b456a2-3273-4c26-88d1-e8c22c249220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:44 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Volume volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c (a045e4c2-fc8b-47e5-94e1-c8aea4ae806c): created successfully
Sep 17 15:24:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b456a2-3273-4c26-88d1-e8c22c249220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Flow 'volume_create_manager' (57f5481d-c502-4daa-a9c6-ef1d5daefe9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:45 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-42329d87-2a9b-4ed2-925e-13f7ae5e6432 tempest-AttachVolumeTestJSON-570979370 None] Created volume successfully.
Sep 17 15:24:45 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Flow 'volume_create_manager' (15c5def9-433a-4193-b7e3-da8541e1b606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d2fd59-f076-4479-ac59-229242e0e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d2fd59-f076-4479-ac59-229242e0e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2096641772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d3eaec-5014-4b7e-a65f-644ca3ff06a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b69a906e94448d18d43879b0f93f286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:45Z,use_quota=True,user_id='ab3d647cda6c445896ccc52f403b983f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba93696-b891-49b5-9726-be6e1349ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba93696-b891-49b5-9726-be6e1349ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8b0689-9ab9-4350-80b8-6ef54051bf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8b0689-9ab9-4350-80b8-6ef54051bf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d3eaec-5014-4b7e-a65f-644ca3ff06a2', 'volume_name': 'volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c107bc-b529-4971-aac0-a731f8f99361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c107bc-b529-4971-aac0-a731f8f99361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30633e6a-060c-4a75-a205-60efdbb66db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:45 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Volume 96d3eaec-5014-4b7e-a65f-644ca3ff06a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2', 'volume_size': 1}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2096641772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d3eaec-5014-4b7e-a65f-644ca3ff06a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b69a906e94448d18d43879b0f93f286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:45Z,use_quota=True,user_id='ab3d647cda6c445896ccc52f403b983f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Creating volume 96d3eaec-5014-4b7e-a65f-644ca3ff06a2 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:45 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:45 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=66, name=volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2 1073741824" returned: 0 in 0.426s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2" returned: 0 in 0.098s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] <== create_volume: return (613ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.628s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30633e6a-060c-4a75-a205-60efdbb66db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fbe708-b9e6-4a42-bc32-56bcfa4dda42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:46 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Volume volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2 (96d3eaec-5014-4b7e-a65f-644ca3ff06a2): created successfully
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fbe708-b9e6-4a42-bc32-56bcfa4dda42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Flow 'volume_create_manager' (15c5def9-433a-4193-b7e3-da8541e1b606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9dbdc161-8efe-4a2f-9fa9-8cc1d8e116d0 tempest-AbsoluteLimitsTests-1629353906 None] Created volume successfully.
Sep 17 15:24:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (90e27cc7-15ec-4757-a00b-c02b452bb8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cef403-c81a-409b-9fae-594ed5918bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cef403-c81a-409b-9fae-594ed5918bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1693837594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec611a8-70f6-4e98-886a-cf6f9d50a69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:46Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44561e-9ada-4c14-b30d-02680f3e9820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44561e-9ada-4c14-b30d-02680f3e9820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec97fa52-c40e-4594-ba13-3374fa2ef745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec97fa52-c40e-4594-ba13-3374fa2ef745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec611a8-70f6-4e98-886a-cf6f9d50a69a', 'volume_name': 'volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eabbce-4c67-44a2-bda3-ec0e02573aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eabbce-4c67-44a2-bda3-ec0e02573aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7652bd5a-fad9-4e3c-96e0-888e2d33b6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:46 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume eec611a8-70f6-4e98-886a-cf6f9d50a69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a', 'volume_size': 1}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1693837594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec611a8-70f6-4e98-886a-cf6f9d50a69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:46Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Creating volume eec611a8-70f6-4e98-886a-cf6f9d50a69a {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:46 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:46 devstack quobyte-client[83236]: System call of process 92323 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:46 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=67, name=volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a 1073741824" returned: 0 in 0.322s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a" returned: 0 in 0.092s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] <== create_volume: return (493ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.516s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7652bd5a-fad9-4e3c-96e0-888e2d33b6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94307b1-fc62-4324-81e6-f35873caa549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Acquiring lock "cinder-96d3eaec-5014-4b7e-a65f-644ca3ff06a2-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:47 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a (eec611a8-70f6-4e98-886a-cf6f9d50a69a): created successfully
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94307b1-fc62-4324-81e6-f35873caa549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (90e27cc7-15ec-4757-a00b-c02b452bb8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Lock "cinder-96d3eaec-5014-4b7e-a65f-644ca3ff06a2-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:47 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-01fd3ebb-c289-41dc-955f-c97e028315d5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created volume successfully.
Sep 17 15:24:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Acquiring lock "cinder-quobyte-96d3eaec-5014-4b7e-a65f-644ca3ff06a2" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Lock "cinder-quobyte-96d3eaec-5014-4b7e-a65f-644ca3ff06a2" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40bf91c-6729-4dcb-83ad-0dd91da99aa3]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2" returned: 0 in 0.450s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-96d3eaec-5014-4b7e-a65f-644ca3ff06a2" returned: 0 in 0.096s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Lock "cinder-quobyte-96d3eaec-5014-4b7e-a65f-644ca3ff06a2" released by "delete_volume" :: held 0.705s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:48 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Created reservations ['b011663e-8ade-4b27-b65a-fbae39ccbcde', 'e45db694-f866-4900-ac05-e883778202bc', '6736319a-7adf-4e0f-979b-48fc9fe0c5d4', 'eb3d893b-be4e-4b83-a37f-1970a45937d8'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.157s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:24:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Deleted volume successfully.
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a7173645-40f9-42d0-a8c9-1251553686d6 tempest-AbsoluteLimitsTests-1629353906 None] Lock "cinder-96d3eaec-5014-4b7e-a65f-644ca3ff06a2-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:49 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (574f2d1f-0f1b-4301-b732-768d37bc7d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ea2344-1376-4be2-a5bc-30fb83fc6d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (deafb859-1840-4938-b680-42b5fa3a806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f46a4ad-2b37-44f7-a549-8d03323d9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f46a4ad-2b37-44f7-a549-8d03323d9350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001187225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db51862-919c-4ea9-87e1-a81082c1e640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:50Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d323b5-23a7-4603-88a1-3c38b1121e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d323b5-23a7-4603-88a1-3c38b1121e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc218f6c-1d47-42e1-83d8-1cda35c7e376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc218f6c-1d47-42e1-83d8-1cda35c7e376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db51862-919c-4ea9-87e1-a81082c1e640', 'volume_name': 'volume-8db51862-919c-4ea9-87e1-a81082c1e640', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0128fa54-96e9-46a9-b432-979ed0aab005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0128fa54-96e9-46a9-b432-979ed0aab005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6747535-6223-4200-b8e9-1948447f38a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume 8db51862-919c-4ea9-87e1-a81082c1e640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db51862-919c-4ea9-87e1-a81082c1e640', 'volume_size': 1}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001187225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db51862-919c-4ea9-87e1-a81082c1e640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:50Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Creating volume 8db51862-919c-4ea9-87e1-a81082c1e640 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:50 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8db51862-919c-4ea9-87e1-a81082c1e640 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:50 devstack quobyte-client[83236]: System call of process 92340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:50 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=68, name=volume-8db51862-919c-4ea9-87e1-a81082c1e640, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ea2344-1376-4be2-a5bc-30fb83fc6d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656740913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292c5771-ce96-4642-b913-6a77fd95368b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:49Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae66768-95ac-4c16-b6b3-1525294f0200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae66768-95ac-4c16-b6b3-1525294f0200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88e6472-4d96-4d83-b730-6a178b32963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88e6472-4d96-4d83-b730-6a178b32963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '292c5771-ce96-4642-b913-6a77fd95368b', 'volume_name': 'volume-292c5771-ce96-4642-b913-6a77fd95368b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0efbf5-1121-47a7-974d-90dae60cc8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0efbf5-1121-47a7-974d-90dae60cc8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d554db44-fb41-4d15-9925-0e74ca71d648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:50 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume 292c5771-ce96-4642-b913-6a77fd95368b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-292c5771-ce96-4642-b913-6a77fd95368b', 'volume_size': 1}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-a7b665e9-4f38-4558-9a4e-450bc954e598 req-80914912-392b-40bc-bba3-30b10187beb8 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8db51862-919c-4ea9-87e1-a81082c1e640 1073741824" returned: 0 in 0.729s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:50 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (c6ba16db-bf7e-43c9-8f94-d5570134fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f405d6-ddd2-45f7-8eaa-18414262f9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8db51862-919c-4ea9-87e1-a81082c1e640 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:51 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (5829f159-4175-4440-a0be-2a3fede92a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16ad981-b302-49ca-a0a3-acaa804195b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f405d6-ddd2-45f7-8eaa-18414262f9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664513885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:50Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01559607-adcd-4702-be48-af01e0083425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01559607-adcd-4702-be48-af01e0083425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001939ea-89e7-464e-9bc0-d5d1fedf93ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001939ea-89e7-464e-9bc0-d5d1fedf93ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98', 'volume_name': 'volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c20cf6-f399-4b58-9d94-0ba263b4300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c20cf6-f399-4b58-9d94-0ba263b4300f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6bdb7b-bbb2-4b8e-96fd-0f952f9adb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume 6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98', 'volume_size': 1}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16ad981-b302-49ca-a0a3-acaa804195b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907858254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc30dd9-9a5d-411a-a4b7-86f71e5991e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:51Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab76652a-80a0-446f-ae22-e567b9fa9fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab76652a-80a0-446f-ae22-e567b9fa9fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae7faab-2ec7-43e4-bec4-ae8d2e112939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae7faab-2ec7-43e4-bec4-ae8d2e112939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc30dd9-9a5d-411a-a4b7-86f71e5991e5', 'volume_name': 'volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca142e-b662-42e5-b27e-435e268b47c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca142e-b662-42e5-b27e-435e268b47c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0503cb-c688-42d3-a30b-4bedf7b83bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume 8dc30dd9-9a5d-411a-a4b7-86f71e5991e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5', 'volume_size': 1}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8db51862-919c-4ea9-87e1-a81082c1e640" returned: 0 in 0.745s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:51 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (1d6a7070-49d0-4559-82ff-b591f067f4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e3dbd9-e666-4d16-a439-21d1836cb9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] <== create_volume: return (1597ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656740913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292c5771-ce96-4642-b913-6a77fd95368b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:49Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Creating volume 292c5771-ce96-4642-b913-6a77fd95368b {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:51 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-292c5771-ce96-4642-b913-6a77fd95368b 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:52 devstack quobyte-client[83236]: System call of process 92349 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:52 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=69, name=volume-292c5771-ce96-4642-b913-6a77fd95368b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e3dbd9-e666-4d16-a439-21d1836cb9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-209227101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a901614b-1d2c-470b-99a9-01d1174d7be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:51Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f9bc78-ea6f-4736-8cfe-4eaf0a9886e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f9bc78-ea6f-4736-8cfe-4eaf0a9886e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec57240-7dca-4eca-93b8-b87acced06f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec57240-7dca-4eca-93b8-b87acced06f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a901614b-1d2c-470b-99a9-01d1174d7be8', 'volume_name': 'volume-a901614b-1d2c-470b-99a9-01d1174d7be8', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9b16da-9c6a-4a46-80f0-d1800d1be630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9b16da-9c6a-4a46-80f0-d1800d1be630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c4c5e1-8ae8-4fa5-a310-cbfe849d82a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:52 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume a901614b-1d2c-470b-99a9-01d1174d7be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a901614b-1d2c-470b-99a9-01d1174d7be8', 'volume_size': 1}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6747535-6223-4200-b8e9-1948447f38a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db51862-919c-4ea9-87e1-a81082c1e640', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70485b0-ab66-43ee-b19c-1d7dff008c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-292c5771-ce96-4642-b913-6a77fd95368b 1073741824" returned: 0 in 0.519s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-292c5771-ce96-4642-b913-6a77fd95368b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:52 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume volume-8db51862-919c-4ea9-87e1-a81082c1e640 (8db51862-919c-4ea9-87e1-a81082c1e640): created successfully
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70485b0-ab66-43ee-b19c-1d7dff008c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (deafb859-1840-4938-b680-42b5fa3a806b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-292c5771-ce96-4642-b913-6a77fd95368b" returned: 0 in 0.393s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] <== create_volume: return (935ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-a7b665e9-4f38-4558-9a4e-450bc954e598 req-80914912-392b-40bc-bba3-30b10187beb8 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.865s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:52 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9f7c6743-ba88-4a4c-92a0-77e10a73608a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created volume successfully.
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cf1ee7-6d89-4e68-801c-5ebce96db640]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-a7b665e9-4f38-4558-9a4e-450bc954e598 req-80914912-392b-40bc-bba3-30b10187beb8 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d554db44-fb41-4d15-9925-0e74ca71d648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-292c5771-ce96-4642-b913-6a77fd95368b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66cd26e-a28f-496b-b61f-f1799430f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:53 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume volume-292c5771-ce96-4642-b913-6a77fd95368b (292c5771-ce96-4642-b913-6a77fd95368b): created successfully
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66cd26e-a28f-496b-b61f-f1799430f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (574f2d1f-0f1b-4301-b732-768d37bc7d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:53 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ecea19da-5595-447d-ba7f-b6b0818ce619 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created volume successfully.
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-a7b665e9-4f38-4558-9a4e-450bc954e598 req-80914912-392b-40bc-bba3-30b10187beb8 tempest-AttachVolumeTestJSON-570979370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c" returned: 0 in 0.680s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-a7b665e9-4f38-4558-9a4e-450bc954e598 req-80914912-392b-40bc-bba3-30b10187beb8 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.753s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.871s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664513885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:50Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Creating volume 6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:53 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:53 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=70, name=volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-a7b665e9-4f38-4558-9a4e-450bc954e598 req-80914912-392b-40bc-bba3-30b10187beb8 tempest-AttachVolumeTestJSON-570979370 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '165731c5-467c-4a60-8e29-31eb1cbd29a4', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:24:54 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-a7b665e9-4f38-4558-9a4e-450bc954e598 req-80914912-392b-40bc-bba3-30b10187beb8 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98 1073741824" returned: 0 in 0.593s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98" returned: 0 in 0.333s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] <== create_volume: return (970ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.881s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907858254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc30dd9-9a5d-411a-a4b7-86f71e5991e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:51Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Creating volume 8dc30dd9-9a5d-411a-a4b7-86f71e5991e5 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:54 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:54 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=71, name=volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6bdb7b-bbb2-4b8e-96fd-0f952f9adb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a550fa35-3cba-4f8d-a61b-c072625a3326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:55 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98 (6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98): created successfully
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a550fa35-3cba-4f8d-a61b-c072625a3326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (c6ba16db-bf7e-43c9-8f94-d5570134fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5 1073741824" returned: 0 in 0.582s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:55 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c23885c8-bbe9-45a1-98ce-849713ea4361 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created volume successfully.
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5" returned: 0 in 0.378s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] <== create_volume: return (995ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.425s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-209227101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a901614b-1d2c-470b-99a9-01d1174d7be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2c81287d214965a8b14914d83bbf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:51Z,use_quota=True,user_id='76233ef68ab44602b4aef750effb68d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Creating volume a901614b-1d2c-470b-99a9-01d1174d7be8 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:55 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a901614b-1d2c-470b-99a9-01d1174d7be8 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:55 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=72, name=volume-a901614b-1d2c-470b-99a9-01d1174d7be8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0503cb-c688-42d3-a30b-4bedf7b83bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e87fc5-8239-46d8-ab0f-7e5466ac9a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:56 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-a7b665e9-4f38-4558-9a4e-450bc954e598 req-80914912-392b-40bc-bba3-30b10187beb8 tempest-AttachVolumeTestJSON-570979370 None] attachment_update completed successfully.
Sep 17 15:24:56 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5 (8dc30dd9-9a5d-411a-a4b7-86f71e5991e5): created successfully
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e87fc5-8239-46d8-ab0f-7e5466ac9a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (5829f159-4175-4440-a0be-2a3fede92a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a901614b-1d2c-470b-99a9-01d1174d7be8 1073741824" returned: 0 in 0.512s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a901614b-1d2c-470b-99a9-01d1174d7be8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a901614b-1d2c-470b-99a9-01d1174d7be8" returned: 0 in 0.170s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] <== create_volume: return (787ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:56 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b4e1bfe2-a63c-4ee2-ac8e-0bd4711c08cc tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created volume successfully.
Sep 17 15:24:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c4c5e1-8ae8-4fa5-a310-cbfe849d82a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a901614b-1d2c-470b-99a9-01d1174d7be8', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3c832c-0a1d-43e6-b60e-f757927dac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:57 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume volume-a901614b-1d2c-470b-99a9-01d1174d7be8 (a901614b-1d2c-470b-99a9-01d1174d7be8): created successfully
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3c832c-0a1d-43e6-b60e-f757927dac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Flow 'volume_create_manager' (1d6a7070-49d0-4559-82ff-b591f067f4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:57 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Flow 'volume_create_manager' (91cf39fa-60f9-49a3-968a-bbabb42507d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5d869e-7e58-4080-a643-bf8b6994562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5d869e-7e58-4080-a643-bf8b6994562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-436685452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4b8f07-1846-427e-84ae-e573dfd47207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb1c69fffe04dd8a9e03c87c71859fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:57Z,use_quota=True,user_id='6152e103c7f9484a9e0d4dd3eaa96859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3869851-08a8-4fb7-a6b9-266a907d4510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3869851-08a8-4fb7-a6b9-266a907d4510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c7f6c3-395e-4735-9731-d43076529bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c7f6c3-395e-4735-9731-d43076529bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4b8f07-1846-427e-84ae-e573dfd47207', 'volume_name': 'volume-2f4b8f07-1846-427e-84ae-e573dfd47207', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa3ffd9-19e7-44fe-840e-ae427671bd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa3ffd9-19e7-44fe-840e-ae427671bd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb959c4-7397-41d3-9bc2-b03b6436357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:57 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Volume 2f4b8f07-1846-427e-84ae-e573dfd47207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4b8f07-1846-427e-84ae-e573dfd47207', 'volume_size': 1}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-436685452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4b8f07-1846-427e-84ae-e573dfd47207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb1c69fffe04dd8a9e03c87c71859fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:24:57Z,use_quota=True,user_id='6152e103c7f9484a9e0d4dd3eaa96859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Creating volume 2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:24:57 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:57 devstack quobyte-client[83236]: System call of process 92393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:24:57 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-08cc7541-f801-470b-a2fc-86c0fa251d4b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created volume successfully.
Sep 17 15:24:57 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=73, name=volume-2f4b8f07-1846-427e-84ae-e573dfd47207, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 1073741824" returned: 0 in 0.455s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207" returned: 0 in 0.166s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] <== create_volume: return (674ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:24:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-a901614b-1d2c-470b-99a9-01d1174d7be8-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb959c4-7397-41d3-9bc2-b03b6436357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4b8f07-1846-427e-84ae-e573dfd47207', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee91d971-fd3b-413a-907d-3b6f1592f9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-a901614b-1d2c-470b-99a9-01d1174d7be8-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:58 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Volume volume-2f4b8f07-1846-427e-84ae-e573dfd47207 (2f4b8f07-1846-427e-84ae-e573dfd47207): created successfully
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee91d971-fd3b-413a-907d-3b6f1592f9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Flow 'volume_create_manager' (91cf39fa-60f9-49a3-968a-bbabb42507d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:24:58 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b8134f9b-7ca5-4dc9-86ca-5adc1f64f887 tempest-VolumesDeleteCascade-1787835905 None] Created volume successfully.
Sep 17 15:24:58 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-quobyte-a901614b-1d2c-470b-99a9-01d1174d7be8" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-a901614b-1d2c-470b-99a9-01d1174d7be8" acquired by "delete_volume" :: waited 0.024s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb98ace7-f685-43ba-b264-7371b2ef9471]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a901614b-1d2c-470b-99a9-01d1174d7be8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a901614b-1d2c-470b-99a9-01d1174d7be8" returned: 0 in 0.452s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a901614b-1d2c-470b-99a9-01d1174d7be8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:24:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a901614b-1d2c-470b-99a9-01d1174d7be8" returned: 0 in 0.310s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:24:59 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:24:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:24:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:24:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-a901614b-1d2c-470b-99a9-01d1174d7be8" released by "delete_volume" :: held 0.965s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:24:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Creating offline snapshot 9e1e7955-960f-4dd9-8390-eb53439a929b of volume 2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:24:59 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc6e46-0fa4-471b-a0ee-5e0f85521bfb]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:24:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:00 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created reservations ['aed9902c-0dd8-4b87-8dcc-528a32b90cb4', '7dd5afbc-d987-4175-8941-0a2768a05b72', '36cc5b69-5554-4b8d-9b2e-f27e74337850', '5a86a669-184c-4534-b982-a8345feaff14'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207" returned: 0 in 0.560s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:00 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=74, name=volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:25:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b 1G" returned: 0 in 0.498s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2f4b8f07-1846-427e-84ae-e573dfd47207 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5-delete_volume" acquired by "delete_volume" :: waited 0.246s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img rebase -u -b volume-2f4b8f07-1846-427e-84ae-e573dfd47207 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b" returned: 0 in 0.703s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:01 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-quobyte-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.710s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Deleted volume successfully.
Sep 17 15:25:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b" returned: 0 in 0.473s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5" acquired by "delete_volume" :: waited 0.375s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b" returned: 0 in 0.333s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0a3ffa-8ceb-4e72-a853-5231207cf55a]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-dd85eea1-6d46-4d52-88c7-739f6880ea34 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-a901614b-1d2c-470b-99a9-01d1174d7be8-delete_volume" released by "delete_volume" :: held 4.219s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.info" returned: 0 in 0.337s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.info" returned: 0 in 0.176s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.352s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=118,cinder:SELECT=83,cinder:DELETE=11,cinder:INSERT=33 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=95,cinder:UPDATE=119,cinder:DELETE=16,cinder:INSERT=20 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5" returned: 0 in 0.806s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a41d668f-32b6-40bb-a846-26db7a6c1a63 tempest-VolumesDeleteCascade-1787835905 None] Create snapshot completed successfully
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5" returned: 0 in 0.344s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5" released by "delete_volume" :: held 1.400s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:03 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Creating offline snapshot 7c8bbcac-de60-4ab8-a162-409e52765cf3 of volume 2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee4151a-d9fb-46ae-a8a6-bab5a1e6c51b]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:04 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created reservations ['dfe5e276-a880-41dd-88e9-4cc75310ace7', '7f4a9fe6-60ee-437b-adc6-b835ab27bf68', '52ff7e7a-a786-43f4-b5b1-a8f26178be4e', 'daaa7f96-289d-4851-aea6-f31aeb5c8f03'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b" returned: 0 in 1.088s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f4b8f07-1846-427e-84ae-e573dfd47207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:25:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:05 devstack quobyte-client[83236]: System call of process 92525 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:05 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=76, name=volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:25:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 1.269s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:06 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98-delete_volume" acquired by "delete_volume" :: waited 0.537s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:06 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Deleted volume successfully.
Sep 17 15:25:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 1G" returned: 0 in 1.113s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:06 devstack quobyte-client[83236]: System call of process 92582 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6beccc6f-9a2b-4ec4-b4af-ee518f536c6e tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-8dc30dd9-9a5d-411a-a4b7-86f71e5991e5-delete_volume" released by "delete_volume" :: held 6.072s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img rebase -u -b volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3" returned: 0 in 0.579s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:07 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-quobyte-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3" returned: 0 in 0.301s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98" acquired by "delete_volume" :: waited 0.225s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82b9b0d-b842-49a2-b86e-0cb1069485d2]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3" returned: 0 in 0.234s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.857s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:08 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c902a602-3391-440c-b8b4-e5060ea2fe4c tempest-VolumesDeleteCascade-1787835905 None] Create snapshot completed successfully
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98" returned: 0 in 0.527s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98" returned: 0 in 0.101s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-2f4b8f07-1846-427e-84ae-e573dfd47207-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98" released by "delete_volume" :: held 0.957s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-2f4b8f07-1846-427e-84ae-e573dfd47207-delete_volume" acquired by "delete_volume" :: waited 0.177s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:08 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Performing cascade delete. {{(pid=83214) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-7c8bbcac-de60-4ab8-a162-409e52765cf3-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-7c8bbcac-de60-4ab8-a162-409e52765cf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:08 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created reservations ['665e224d-e28a-4ebe-beda-83f519c2b057', 'c20649b4-95a3-4750-b16f-9de53faca988', 'e993e76e-a5c1-411a-a266-36069a6fb50d', 'e22211b3-87f5-4726-8811-6294ff4962a2'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-2f4b8f07-1846-427e-84ae-e573dfd47207" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-2f4b8f07-1846-427e-84ae-e573dfd47207" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-7c8bbcac-de60-4ab8-a162-409e52765cf3" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-7c8bbcac-de60-4ab8-a162-409e52765cf3" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Deleting offline snapshot 7c8bbcac-de60-4ab8-a162-409e52765cf3 of volume 2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] snapshot_file for this snap is: volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd964a0-c119-4ccf-b555-fd874f2af677]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.150s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:09 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Deleted volume successfully.
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3" returned: 0 in 0.776s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f4b8f07-1846-427e-84ae-e573dfd47207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e5a257-20dc-4f14-9064-e439db7f2474]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:09 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c0c535f7-caf7-470e-9092-05abdfad446b tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-6ace9c1c-1b49-4755-aaa1-e0d4c89d2a98-delete_volume" released by "delete_volume" :: held 3.604s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-8db51862-919c-4ea9-87e1-a81082c1e640-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-8db51862-919c-4ea9-87e1-a81082c1e640-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b" returned: 0 in 0.591s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f4b8f07-1846-427e-84ae-e573dfd47207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:10 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-quobyte-8db51862-919c-4ea9-87e1-a81082c1e640" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3" returned: 0 in 0.373s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-8db51862-919c-4ea9-87e1-a81082c1e640" acquired by "delete_volume" :: waited 0.160s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a6a64b-ba16-49d9-aca5-76646b73720c]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8db51862-919c-4ea9-87e1-a81082c1e640 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.7c8bbcac-de60-4ab8-a162-409e52765cf3" returned: 0 in 0.253s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:11 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-7c8bbcac-de60-4ab8-a162-409e52765cf3" released by "_delete_snapshot" :: held 2.222s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:11 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-2f4b8f07-1846-427e-84ae-e573dfd47207" released by "delete_snapshot" :: held 2.248s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:11 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Created reservations ['e1308eac-aa59-4268-9bc0-b8477e84bb01', '789c00f4-66b3-47a5-b010-82b53fff8b83', '71aca2b9-0e1b-43e5-b0a1-8a6587033a5a', '4b9c37d7-881d-41d6-b7cd-93a52ce557d4'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8db51862-919c-4ea9-87e1-a81082c1e640" returned: 0 in 0.579s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8db51862-919c-4ea9-87e1-a81082c1e640 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8db51862-919c-4ea9-87e1-a81082c1e640" returned: 0 in 0.310s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:11 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-8db51862-919c-4ea9-87e1-a81082c1e640" released by "delete_volume" :: held 1.052s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:12 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Delete snapshot completed successfully.
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created reservations ['3758621f-612e-4049-986a-9bffb49ac778', 'c0cb5654-8d9c-4da7-a2f8-e0a6e5940e22', '640bbbc5-e115-4177-9b3e-8fd3c97d0dea', '18dd1d01-c270-415c-a74f-f986d892c7e2'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-7c8bbcac-de60-4ab8-a162-409e52765cf3-delete_snapshot" released by "delete_snapshot" :: held 3.197s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-9e1e7955-960f-4dd9-8390-eb53439a929b-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-9e1e7955-960f-4dd9-8390-eb53439a929b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.340s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:12 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-2f4b8f07-1846-427e-84ae-e573dfd47207" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.458s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-2f4b8f07-1846-427e-84ae-e573dfd47207" acquired by "delete_snapshot" :: waited 0.074s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-9e1e7955-960f-4dd9-8390-eb53439a929b" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-9e1e7955-960f-4dd9-8390-eb53439a929b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Deleting offline snapshot 9e1e7955-960f-4dd9-8390-eb53439a929b of volume 2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] snapshot_file for this snap is: volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37d82c-6177-48aa-bd92-7594d7ebd4f0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.092s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:13 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:13 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Deleted volume successfully.
Sep 17 15:25:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6f380cd9-3cd4-4530-a089-fb237eb1f44a tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-8db51862-919c-4ea9-87e1-a81082c1e640-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b" returned: 0 in 0.704s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f4b8f07-1846-427e-84ae-e573dfd47207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:25:13 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8b3af3-3e5c-4ae7-afce-1b5cd0bf0d53]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-292c5771-ce96-4642-b913-6a77fd95368b-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-292c5771-ce96-4642-b913-6a77fd95368b-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207" returned: 0 in 0.625s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:14 devstack quobyte-client[83236]: System call of process 92653 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-quobyte-292c5771-ce96-4642-b913-6a77fd95368b" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b" returned: 0 in 0.400s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-292c5771-ce96-4642-b913-6a77fd95368b" acquired by "delete_volume" :: waited 0.165s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2999c5c-314d-43ee-bde1-ff097966c0b0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-292c5771-ce96-4642-b913-6a77fd95368b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207.9e1e7955-960f-4dd9-8390-eb53439a929b" returned: 0 in 0.267s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-9e1e7955-960f-4dd9-8390-eb53439a929b" released by "_delete_snapshot" :: held 2.223s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-2f4b8f07-1846-427e-84ae-e573dfd47207" released by "delete_snapshot" :: held 2.273s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-292c5771-ce96-4642-b913-6a77fd95368b" returned: 0 in 0.545s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-292c5771-ce96-4642-b913-6a77fd95368b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-292c5771-ce96-4642-b913-6a77fd95368b" returned: 0 in 0.260s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-292c5771-ce96-4642-b913-6a77fd95368b" released by "delete_volume" :: held 0.966s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Created reservations ['560b9d60-e711-48fb-925c-3910b129d6d3', '4be4f367-6150-495f-8da1-4902cd8f76ba', 'e4b70407-10b1-4e6d-a93b-a98fdc5bef0c', 'ee1c76e7-09cd-4fbd-9a3d-fbfa9fd1a0fe'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created reservations ['0694d45e-d34f-4178-a697-da85c7e63554', '3a1aa133-9675-42be-88ca-d389eed95ca1', '68c67473-9e26-4b7c-b090-9ffc5a5b5787', '5ea284ed-5cb8-4dfa-bcd1-c12bf7baaa53'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:15 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Delete snapshot completed successfully.
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-9e1e7955-960f-4dd9-8390-eb53439a929b-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Snapshots deleted, issuing volume delete {{(pid=83214) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-2f4b8f07-1846-427e-84ae-e573dfd47207" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-2f4b8f07-1846-427e-84ae-e573dfd47207" acquired by "delete_volume" :: waited 0.030s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9c219-5ef8-4e72-b997-9ee10f9537e8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-eec611a8-70f6-4e98-886a-cf6f9d50a69a-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-eec611a8-70f6-4e98-886a-cf6f9d50a69a-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207" returned: 0 in 0.839s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.394s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:16 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:16 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Deleted volume successfully.
Sep 17 15:25:17 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "cinder-quobyte-eec611a8-70f6-4e98-886a-cf6f9d50a69a" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2f4b8f07-1846-427e-84ae-e573dfd47207" returned: 0 in 0.407s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-2f4b8f07-1846-427e-84ae-e573dfd47207" released by "delete_volume" :: held 1.341s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-aa423767-e6c6-45dc-b6d3-aedd0c5079c5 tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-292c5771-ce96-4642-b913-6a77fd95368b-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-eec611a8-70f6-4e98-886a-cf6f9d50a69a" acquired by "delete_volume" :: waited 0.104s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8684a62b-de7a-462b-b168-93b1739a29c1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Created reservations ['70c40546-36a9-4e4f-8d70-3f83332357c6', 'ce0cd393-3c9a-44e6-ba0a-ff01dc2ead21', '8f79d797-97eb-406f-b297-61feee6fa23a', '29f634f5-8ad3-4959-9410-1e384c22aa1f'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a" returned: 0 in 0.673s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.170s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:18 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Deleted volume successfully.
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eec611a8-70f6-4e98-886a-cf6f9d50a69a" returned: 0 in 0.316s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-quobyte-eec611a8-70f6-4e98-886a-cf6f9d50a69a" released by "delete_volume" :: held 1.143s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5914c990-69f8-4429-8165-7d8f9a0bc11a tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-2f4b8f07-1846-427e-84ae-e573dfd47207-delete_volume" released by "delete_volume" :: held 9.767s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Created reservations ['a1dd0d72-9285-4411-abe0-685878937d25', 'ac0b7830-29b9-4ba5-913f-d174373b6785', '69cd77cd-8364-472a-8f5c-ea559e66aeed', '2da0c905-e090-4992-9135-3cbaecf1cf8e'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.105s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:18 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:18 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Deleted volume successfully.
Sep 17 15:25:19 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Flow 'volume_create_manager' (1ebd3d69-9a71-4920-a293-ae918a3d0de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235013a6-bf3c-49e9-8d0a-57ca169aaf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235013a6-bf3c-49e9-8d0a-57ca169aaf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1296913772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fb7a86-1364-4d37-9147-a99c357a1682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb1c69fffe04dd8a9e03c87c71859fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:19Z,use_quota=True,user_id='6152e103c7f9484a9e0d4dd3eaa96859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d157a28b-44e3-4fb1-9f98-8dce85076d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d157a28b-44e3-4fb1-9f98-8dce85076d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea78e565-182e-4540-8a17-62044cc09fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea78e565-182e-4540-8a17-62044cc09fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fb7a86-1364-4d37-9147-a99c357a1682', 'volume_name': 'volume-a2fb7a86-1364-4d37-9147-a99c357a1682', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2dce84-765e-401e-a63f-5e06396e6acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2dce84-765e-401e-a63f-5e06396e6acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5973a11-7156-41a9-829c-fda7b01ef68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:19 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Volume a2fb7a86-1364-4d37-9147-a99c357a1682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fb7a86-1364-4d37-9147-a99c357a1682', 'volume_size': 1}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1296913772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fb7a86-1364-4d37-9147-a99c357a1682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb1c69fffe04dd8a9e03c87c71859fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:19Z,use_quota=True,user_id='6152e103c7f9484a9e0d4dd3eaa96859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Creating volume a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:25:19 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:19 devstack quobyte-client[83236]: System call of process 92672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:19 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=77, name=volume-a2fb7a86-1364-4d37-9147-a99c357a1682, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b474cad3-29a2-4de3-9a45-6e8c503998ae tempest-CreateVolumesFromSourceVolumeTest-1019602759 None] Lock "cinder-eec611a8-70f6-4e98-886a-cf6f9d50a69a-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 1073741824" returned: 0 in 0.393s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682" returned: 0 in 0.096s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] <== create_volume: return (572ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:25:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.587s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5973a11-7156-41a9-829c-fda7b01ef68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fb7a86-1364-4d37-9147-a99c357a1682', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f320fbb-aba8-46ba-83b2-67a6b2662c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:20 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Volume volume-a2fb7a86-1364-4d37-9147-a99c357a1682 (a2fb7a86-1364-4d37-9147-a99c357a1682): created successfully
Sep 17 15:25:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f320fbb-aba8-46ba-83b2-67a6b2662c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Flow 'volume_create_manager' (1ebd3d69-9a71-4920-a293-ae918a3d0de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b0b23476-a39b-40b1-b450-66e2c90edaad tempest-VolumesDeleteCascade-1787835905 None] Created volume successfully.
Sep 17 15:25:21 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Creating offline snapshot 95e971c3-47fe-4c7c-8552-b1f8fcb866b6 of volume a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:25:21 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adad307-dbee-47a0-9577-4b0c78cc21a0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682" returned: 0 in 0.526s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:22 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=78, name=volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 1G" returned: 0 in 0.258s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a2fb7a86-1364-4d37-9147-a99c357a1682 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img rebase -u -b volume-a2fb7a86-1364-4d37-9147-a99c357a1682 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6" returned: 0 in 0.204s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6" returned: 0 in 0.109s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6" returned: 0 in 0.110s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.info" returned: 0 in 0.111s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:25:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.info" returned: 0 in 0.111s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:23 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b4ce096e-8f1f-4d9b-a72c-b51c18ae7fdd tempest-VolumesDeleteCascade-1787835905 None] Create snapshot completed successfully
Sep 17 15:25:24 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:24 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:25:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Flow 'volume_create_manager' (1400e189-77df-4f1f-957b-99e29ee54c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9736ef70-6be7-426b-a80c-8771985bbc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9736ef70-6be7-426b-a80c-8771985bbc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4588db81-927b-4604-a838-9031d8055bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007c75e8114d4d238f9ce5c6e05d05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:25Z,use_quota=True,user_id='0cf007e1b0b04319aa649f7866d6529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60a3b29-c11b-4530-9dac-ecb989708e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60a3b29-c11b-4530-9dac-ecb989708e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdb87a5-2ba4-4d67-b229-a99be738a94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.image.glance [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Creating Keystone auth plugin from conf {{(pid=83214) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 15:25:25 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Flow 'volume_create_manager' (7ca65fd1-edc3-4efb-b144-d0132b20d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9c1340-7bde-4deb-9eb8-bc4fc7ff0391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9c1340-7bde-4deb-9eb8-bc4fc7ff0391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1759552047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ea3124-5811-4e68-9fe1-2e702335fc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb1c69fffe04dd8a9e03c87c71859fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=95e971c3-47fe-4c7c-8552-b1f8fcb866b6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:25Z,use_quota=True,user_id='6152e103c7f9484a9e0d4dd3eaa96859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbdcf94-b7c6-404c-a79b-726d52a65131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbdcf94-b7c6-404c-a79b-726d52a65131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de7b394-f490-40ad-a708-02c03cf2b5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de7b394-f490-40ad-a708-02c03cf2b5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51ea3124-5811-4e68-9fe1-2e702335fc9e', 'volume_name': 'volume-51ea3124-5811-4e68-9fe1-2e702335fc9e', 'volume_size': 1, 'snapshot_id': '95e971c3-47fe-4c7c-8552-b1f8fcb866b6'}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df6cc1e-be82-4fc8-88c1-13ad6fd9ad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df6cc1e-be82-4fc8-88c1-13ad6fd9ad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe00e32a-7ecf-4548-abb3-3102d2c4a5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Volume 51ea3124-5811-4e68-9fe1-2e702335fc9e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51ea3124-5811-4e68-9fe1-2e702335fc9e', 'volume_size': 1, 'snapshot_id': '95e971c3-47fe-4c7c-8552-b1f8fcb866b6'}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-95e971c3-47fe-4c7c-8552-b1f8fcb866b6-51ea3124-5811-4e68-9fe1-2e702335fc9e" by "_create_volume_from_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-95e971c3-47fe-4c7c-8552-b1f8fcb866b6-51ea3124-5811-4e68-9fe1-2e702335fc9e" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Creating volume 51ea3124-5811-4e68-9fe1-2e702335fc9e from snapshot 95e971c3-47fe-4c7c-8552-b1f8fcb866b6 {{(pid=83214) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-51ea3124-5811-4e68-9fe1-2e702335fc9e" by "_copy_volume_from_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-51ea3124-5811-4e68-9fe1-2e702335fc9e" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] snapshot: 95e971c3-47fe-4c7c-8552-b1f8fcb866b6, volume: 51ea3124-5811-4e68-9fe1-2e702335fc9e,  {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdb87a5-2ba4-4d67-b229-a99be738a94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4588db81-927b-4604-a838-9031d8055bb0', 'volume_name': 'volume-4588db81-927b-4604-a838-9031d8055bb0', 'volume_size': 1, 'image_id': '4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15a963688014b7ce97af52adcf17ced9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '007c75e8114d4d238f9ce5c6e05d05be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '429d5e8bc03e23e8218a7d22fec26593d9143e95d39364325bb0baefe97ca8e61878a1ea7406f1b24c72af2007aa355e866ce43ba0c7d7866447350c84bc1aeb', 'id': '4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'created_at': datetime.datetime(2025, 9, 17, 13, 25, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 25, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9026080>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759e74f7-ff38-4e27-a64e-8cca16f26dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759e74f7-ff38-4e27-a64e-8cca16f26dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0758e4c-4907-494c-a3e5-6fa0654268b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Volume 4588db81-927b-4604-a838-9031d8055bb0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4588db81-927b-4604-a838-9031d8055bb0', 'volume_size': 1, 'image_id': '4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15a963688014b7ce97af52adcf17ced9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '007c75e8114d4d238f9ce5c6e05d05be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '429d5e8bc03e23e8218a7d22fec26593d9143e95d39364325bb0baefe97ca8e61878a1ea7406f1b24c72af2007aa355e866ce43ba0c7d7866447350c84bc1aeb', 'id': '4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'created_at': datetime.datetime(2025, 9, 17, 13, 25, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 25, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9026080>}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Cloning 4588db81-927b-4604-a838-9031d8055bb0 from image 4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a  at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'metadata': {}}]). {{(pid=83214) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a67e14-9e42-4558-abbd-3a8e42598a00]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 15:25:25 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Image download 0.00 MB at 0.00 MB/s
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64b3c3a-5d22-4534-b068-cb3501a0a004]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6" returned: 0 in 0.521s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2fb7a86-1364-4d37-9147-a99c357a1682(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:25:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 15:25:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Creating direct copy from snapshot {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 15:25:26 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6464a48-a831-4932-bc19-1b30808b311e]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:26 devstack sudo[92694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD
Sep 17 15:25:26 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:25:26 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-29842e63-9cc7-46d7-8487-35975e080dde req-ae6b4a99-5be4-4dfc-86b5-9d7cf408a386 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682" returned: 0 in 1.113s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:27 devstack cinder-volume[83214]: DEBUG cinder.utils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e not found in is_blk_device check {{(pid=83214) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 15:25:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:27 devstack quobyte-client[83236]: System call of process 92760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:27 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=80, name=volume-51ea3124-5811-4e68-9fe1-2e702335fc9e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:25:27 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-29842e63-9cc7-46d7-8487-35975e080dde req-ae6b4a99-5be4-4dfc-86b5-9d7cf408a386 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:27 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-29842e63-9cc7-46d7-8487-35975e080dde req-ae6b4a99-5be4-4dfc-86b5-9d7cf408a386 tempest-AttachVolumeTestJSON-570979370 None] Terminate volume connection completed successfully.
Sep 17 15:25:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-29842e63-9cc7-46d7-8487-35975e080dde req-ae6b4a99-5be4-4dfc-86b5-9d7cf408a386 tempest-AttachVolumeTestJSON-570979370 None] Deleting attachment 7f4d3e4f-5de7-4b93-a9f2-288abd399c69. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:25:30 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root
Sep 17 15:25:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD" returned: 0 in 5.073s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:32 devstack sudo[92815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD
Sep 17 15:25:32 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:25:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e" returned: 0 in 6.614s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:33 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d4582a-594e-4614-b72c-8e973fd731e0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682" returned: 0 in 0.654s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:34 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Image conversion details: src /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:25:34 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Converted 1024.00 MB image at 154.03 MB/s
Sep 17 15:25:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:25:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e" returned: 0 in 0.178s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-51ea3124-5811-4e68-9fe1-2e702335fc9e" released by "_copy_volume_from_snapshot" :: held 9.634s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-95e971c3-47fe-4c7c-8552-b1f8fcb866b6-51ea3124-5811-4e68-9fe1-2e702335fc9e" released by "_create_volume_from_snapshot" :: held 9.705s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.730s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:35 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root
Sep 17 15:25:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe00e32a-7ecf-4548-abb3-3102d2c4a5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ea3124-5811-4e68-9fe1-2e702335fc9e', 'volume_size': 1, 'snapshot_id': '95e971c3-47fe-4c7c-8552-b1f8fcb866b6'}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f9137b-a939-4fa5-b8c9-db53e1f84285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD" returned: 1 in 4.562s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:25:35 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Temporary image 4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a is fetched for user 0cf007e1b0b04319aa649f7866d6529c. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 15:25:35 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Volume volume-51ea3124-5811-4e68-9fe1-2e702335fc9e (51ea3124-5811-4e68-9fe1-2e702335fc9e): created successfully
Sep 17 15:25:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f9137b-a939-4fa5-b8c9-db53e1f84285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Flow 'volume_create_manager' (7ca65fd1-edc3-4efb-b144-d0132b20d319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:35 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-906b2aa1-eb80-4b01-9a50-b99c75607c9f tempest-VolumesDeleteCascade-1787835905 None] Created volume successfully.
Sep 17 15:25:35 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d22df51-ddb4-416a-801d-b91113da109f]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:35 devstack sudo[92831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD
Sep 17 15:25:36 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-a2fb7a86-1364-4d37-9147-a99c357a1682-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-a2fb7a86-1364-4d37-9147-a99c357a1682-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Performing cascade delete. {{(pid=83214) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-95e971c3-47fe-4c7c-8552-b1f8fcb866b6-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-95e971c3-47fe-4c7c-8552-b1f8fcb866b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-a2fb7a86-1364-4d37-9147-a99c357a1682" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-a2fb7a86-1364-4d37-9147-a99c357a1682" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-95e971c3-47fe-4c7c-8552-b1f8fcb866b6" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-95e971c3-47fe-4c7c-8552-b1f8fcb866b6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Deleting offline snapshot 95e971c3-47fe-4c7c-8552-b1f8fcb866b6 of volume a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] snapshot_file for this snap is: volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d057a-6211-4764-a536-526d4eee99a6]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:37 devstack quobyte-client[83236]: System call of process 92833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6" returned: 0 in 0.482s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2fb7a86-1364-4d37-9147-a99c357a1682(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:25:37 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc2e573-1002-44a4-b001-a0ad43d8837a]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682" returned: 0 in 0.709s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:38 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root
Sep 17 15:25:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD" returned: 0 in 2.557s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6" returned: 0 in 0.218s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682.95e971c3-47fe-4c7c-8552-b1f8fcb866b6" returned: 0 in 0.131s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-95e971c3-47fe-4c7c-8552-b1f8fcb866b6" released by "_delete_snapshot" :: held 1.889s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-a2fb7a86-1364-4d37-9147-a99c357a1682" released by "delete_snapshot" :: held 1.915s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:38 devstack sudo[92844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD
Sep 17 15:25:38 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Created reservations ['464a32e3-c80c-4a91-866d-a1a1747163ae', 'a896386a-58ff-4ae2-855d-e97ebb5fa01f', '38e5a59c-908f-488b-9b68-042701c9c922', 'c015241f-14ad-4125-a1ac-02ce58e42de5'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Delete snapshot completed successfully.
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-95e971c3-47fe-4c7c-8552-b1f8fcb866b6-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Snapshots deleted, issuing volume delete {{(pid=83214) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-a2fb7a86-1364-4d37-9147-a99c357a1682" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-a2fb7a86-1364-4d37-9147-a99c357a1682" acquired by "delete_volume" :: waited 0.025s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5844ea32-e8d6-43d0-b239-18d397fa0d64]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682" returned: 0 in 0.454s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a2fb7a86-1364-4d37-9147-a99c357a1682" returned: 0 in 0.102s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-a2fb7a86-1364-4d37-9147-a99c357a1682" released by "delete_volume" :: held 0.761s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:40 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Created reservations ['adc40ad2-c4df-436e-a796-46a07637f47a', '756be9b6-5d0c-49d8-825b-73d1f9dd1a7e', '250839c7-ee62-4077-b828-c9aa46a75bbe', '746235dd-10aa-49a1-bf12-b98f4cf589cf'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.176s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:40 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:40 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root
Sep 17 15:25:40 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Deleted volume successfully.
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD" returned: 1 in 2.844s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4588db81-927b-4604-a838-9031d8055bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007c75e8114d4d238f9ce5c6e05d05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:25Z,use_quota=True,user_id='0cf007e1b0b04319aa649f7866d6529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Creating volume 4588db81-927b-4604-a838-9031d8055bb0 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:25:41 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:41 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=81, name=volume-4588db81-927b-4604-a838-9031d8055bb0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-51ea3124-5811-4e68-9fe1-2e702335fc9e-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ea751d05-41c4-4b20-b63b-f04726ef9b12 tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-a2fb7a86-1364-4d37-9147-a99c357a1682-delete_volume" released by "delete_volume" :: held 5.167s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-51ea3124-5811-4e68-9fe1-2e702335fc9e-delete_volume" acquired by "delete_volume" :: waited 0.240s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 1073741824" returned: 0 in 0.544s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0" returned: 0 in 0.206s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:25:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:42 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:42 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "cinder-quobyte-51ea3124-5811-4e68-9fe1-2e702335fc9e" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:42 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-51ea3124-5811-4e68-9fe1-2e702335fc9e" acquired by "delete_volume" :: waited 0.058s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:42 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Attempting download of 4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a ((None, [{'url': 'file:///opt/stack/data/glance/images/4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'metadata': {}}])) to volume 4588db81-927b-4604-a838-9031d8055bb0. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 15:25:42 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1646f753-e2bd-477e-978f-a8bf3cf059d5]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:42 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a3abe2-874e-441b-b893-15c2d3531aae]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_sn0ajy1n {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:42 devstack quobyte-client[83236]: System call of process 92859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e" returned: 0 in 0.758s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51ea3124-5811-4e68-9fe1-2e702335fc9e" returned: 0 in 0.329s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_sn0ajy1n" returned: 0 in 0.652s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_sn0ajy1n {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-quobyte-51ea3124-5811-4e68-9fe1-2e702335fc9e" released by "delete_volume" :: held 1.464s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_sn0ajy1n" returned: 1 in 0.548s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_sn0ajy1n' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:25:44 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[507d3ae5-5eca-4e13-846d-9d4e5baf2c73]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:44 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Created reservations ['8e8277a7-61a8-480d-a425-9a15a2d8c459', '21fce55a-73d4-4969-b84e-449a4c158b1f', '421de03c-6236-464e-b28d-63a3e628c3c3', '569d7a0c-4832-4e7b-96ea-1028b0efc075'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.045s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.142s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:45 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Deleted volume successfully.
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] 4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a was raw, converting to raw {{(pid=83214) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:45 devstack quobyte-client[83236]: System call of process 92881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:45 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=81, name=volume-4588db81-927b-4604-a838-9031d8055bb0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2a8becf0-6ed9-4112-84ff-2d5b352bbe4c tempest-VolumesDeleteCascade-1787835905 None] Lock "cinder-51ea3124-5811-4e68-9fe1-2e702335fc9e-delete_volume" released by "delete_volume" :: held 4.220s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0" returned: 0 in 0.379s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a_8pt20g9rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:25:45 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Converted 0.00 MB image at 0.00 MB/s
Sep 17 15:25:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 1G" returned: 0 in 0.138s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:46 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4814ee0a-3e77-4178-8d44-d79f538c1b7f]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0" returned: 0 in 0.486s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0" returned: 1 in 0.533s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Downloaded image 4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a ((None, [{'url': 'file:///opt/stack/data/glance/images/4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'metadata': {}}])) to volume 4588db81-927b-4604-a838-9031d8055bb0 successfully. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Temporary image 4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a for user 0cf007e1b0b04319aa649f7866d6529c is deleted. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Marking volume 4588db81-927b-4604-a838-9031d8055bb0 as bootable. {{(pid=83214) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Copying metadata from image 4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a to 4588db81-927b-4604-a838-9031d8055bb0. {{(pid=83214) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Creating volume glance metadata for volume 4588db81-927b-4604-a838-9031d8055bb0 backed by image 4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a with: {'image_id': '4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '15a963688014b7ce97af52adcf17ced9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83214) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0758e4c-4907-494c-a3e5-6fa0654268b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4588db81-927b-4604-a838-9031d8055bb0', 'volume_size': 1, 'image_id': '4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15a963688014b7ce97af52adcf17ced9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '007c75e8114d4d238f9ce5c6e05d05be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '429d5e8bc03e23e8218a7d22fec26593d9143e95d39364325bb0baefe97ca8e61878a1ea7406f1b24c72af2007aa355e866ce43ba0c7d7866447350c84bc1aeb', 'id': '4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a', 'created_at': datetime.datetime(2025, 9, 17, 13, 25, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 25, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ed56ebf-58ab-4a8c-b687-ce8ea7c5eb6a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9026080>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbbf7ca-1129-4089-9e04-7519fdb30e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:47 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Volume volume-4588db81-927b-4604-a838-9031d8055bb0 (4588db81-927b-4604-a838-9031d8055bb0): created successfully
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbbf7ca-1129-4089-9e04-7519fdb30e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Flow 'volume_create_manager' (1400e189-77df-4f1f-957b-99e29ee54c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:47 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-72fb878a-98c4-44ea-b99f-a05fb02b7ed5 tempest-VolumeImageDependencyTests-2145023041 None] Created volume successfully.
Sep 17 15:25:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Acquiring lock "cinder-4588db81-927b-4604-a838-9031d8055bb0-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Lock "cinder-4588db81-927b-4604-a838-9031d8055bb0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:48 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Acquiring lock "cinder-quobyte-4588db81-927b-4604-a838-9031d8055bb0" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Lock "cinder-quobyte-4588db81-927b-4604-a838-9031d8055bb0" acquired by "delete_volume" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:48 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6559be0-36e0-4cc4-87c6-bde01b9e4786]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0" returned: 0 in 0.411s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0" returned: 1 in 0.429s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-4588db81-927b-4604-a838-9031d8055bb0" returned: 0 in 0.372s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Flow 'volume_create_manager' (98e9b09b-21b9-45db-8386-301705557ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1c32b2-a1ba-47ef-81c7-727cee6508a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Lock "cinder-quobyte-4588db81-927b-4604-a838-9031d8055bb0" released by "delete_volume" :: held 1.534s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1c32b2-a1ba-47ef-81c7-727cee6508a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-535668835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880f8ed9-b8fc-46a2-8859-e6a06850db75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863994e77c0a4c51ac928fd4d6a02518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:49Z,use_quota=True,user_id='ac72fe6aac494a19850e966bf245e459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d46d11d-92dd-4da1-966e-258e772dc256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d46d11d-92dd-4da1-966e-258e772dc256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eb5f86-dcba-4562-aeb0-40d74d7359bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eb5f86-dcba-4562-aeb0-40d74d7359bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '880f8ed9-b8fc-46a2-8859-e6a06850db75', 'volume_name': 'volume-880f8ed9-b8fc-46a2-8859-e6a06850db75', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ca7460-a708-4603-8ffd-4f2a960a7aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ca7460-a708-4603-8ffd-4f2a960a7aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3d6001-6ab2-4477-9cc1-139854ccddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:49 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Volume 880f8ed9-b8fc-46a2-8859-e6a06850db75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-880f8ed9-b8fc-46a2-8859-e6a06850db75', 'volume_size': 1}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-535668835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880f8ed9-b8fc-46a2-8859-e6a06850db75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863994e77c0a4c51ac928fd4d6a02518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:49Z,use_quota=True,user_id='ac72fe6aac494a19850e966bf245e459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Creating volume 880f8ed9-b8fc-46a2-8859-e6a06850db75 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:25:49 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:25:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-880f8ed9-b8fc-46a2-8859-e6a06850db75 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:50 devstack quobyte-client[83236]: System call of process 92898 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:50 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=82, name=volume-880f8ed9-b8fc-46a2-8859-e6a06850db75, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-880f8ed9-b8fc-46a2-8859-e6a06850db75 1073741824" returned: 0 in 0.464s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-880f8ed9-b8fc-46a2-8859-e6a06850db75 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Created reservations ['b65e9b38-376a-4273-9f5c-f1af739f46e4', '7175f53b-f513-4eb8-a87c-379e15dcc150', '0884c9ea-2ea3-469c-885b-1dfa07680d6e', '2d43aa2b-c92a-4732-83e8-c008e685a9b3'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-880f8ed9-b8fc-46a2-8859-e6a06850db75" returned: 0 in 0.291s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] <== create_volume: return (786ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3d6001-6ab2-4477-9cc1-139854ccddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-880f8ed9-b8fc-46a2-8859-e6a06850db75', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e8958e-43cd-4952-b616-a33602e7325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:50 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Volume volume-880f8ed9-b8fc-46a2-8859-e6a06850db75 (880f8ed9-b8fc-46a2-8859-e6a06850db75): created successfully
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e8958e-43cd-4952-b616-a33602e7325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Flow 'volume_create_manager' (98e9b09b-21b9-45db-8386-301705557ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:50 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d45284d6-541f-432a-a5df-0e1c65576c28 tempest-VolumesMetadataTest-1504982686 None] Created volume successfully.
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.166s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:51 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Deleted volume successfully.
Sep 17 15:25:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b173a434-eb69-4cb3-abd2-716422a6f6d4 tempest-VolumeImageDependencyTests-2145023041 None] Lock "cinder-4588db81-927b-4604-a838-9031d8055bb0-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Acquiring lock "cinder-880f8ed9-b8fc-46a2-8859-e6a06850db75-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Lock "cinder-880f8ed9-b8fc-46a2-8859-e6a06850db75-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:52 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Acquiring lock "cinder-quobyte-880f8ed9-b8fc-46a2-8859-e6a06850db75" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:25:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Lock "cinder-quobyte-880f8ed9-b8fc-46a2-8859-e6a06850db75" acquired by "delete_volume" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:25:52 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a6a4a-a5a5-4afd-b089-3b6134005a27]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:25:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-880f8ed9-b8fc-46a2-8859-e6a06850db75 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:53 devstack quobyte-client[83236]: System call of process 92903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-880f8ed9-b8fc-46a2-8859-e6a06850db75" returned: 0 in 0.597s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-880f8ed9-b8fc-46a2-8859-e6a06850db75 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-c26c025d-5f0f-447a-beb5-894e6537ed79 req-c9575a5f-c22c-40e3-8277-c99ff5dda0f4 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-880f8ed9-b8fc-46a2-8859-e6a06850db75" returned: 0 in 0.427s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:54 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-c26c025d-5f0f-447a-beb5-894e6537ed79 req-c9575a5f-c22c-40e3-8277-c99ff5dda0f4 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:54 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-c26c025d-5f0f-447a-beb5-894e6537ed79 req-c9575a5f-c22c-40e3-8277-c99ff5dda0f4 tempest-AttachVolumeTestJSON-570979370 None] Terminate volume connection completed successfully.
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-c26c025d-5f0f-447a-beb5-894e6537ed79 req-c9575a5f-c22c-40e3-8277-c99ff5dda0f4 tempest-AttachVolumeTestJSON-570979370 None] Deleting attachment 165731c5-467c-4a60-8e29-31eb1cbd29a4. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Lock "cinder-quobyte-880f8ed9-b8fc-46a2-8859-e6a06850db75" released by "delete_volume" :: held 1.222s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Created reservations ['df3aa614-6204-4d04-812f-84c99ea7b378', '72307db9-5efd-46bf-a3b4-b2a531e9dd12', '82ecb191-f2a5-40b4-be07-33a66dacd158', '2f645471-acbd-4f47-8158-c0a9947a3e21'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.108s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:25:54 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Deleted volume successfully.
Sep 17 15:25:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8903a433-23fe-428c-b0f6-2c3ef4c78ad1 tempest-VolumesMetadataTest-1504982686 None] Lock "cinder-880f8ed9-b8fc-46a2-8859-e6a06850db75-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:25:55 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:55 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:25:55 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Flow 'volume_create_manager' (fd2b680f-644f-4b3e-b11b-40d7325089d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:55 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76a1959-f9b9-4b9d-b7b2-f9bf1951c498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76a1959-f9b9-4b9d-b7b2-f9bf1951c498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc306dd8-9784-43ab-b845-92a478de1512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c4bc265e3e4975a71c9630c288bed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:56Z,use_quota=True,user_id='df76b96761a2458cb89fd70156ac6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6836228-8ea4-4be7-8552-5993c9d3ba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6836228-8ea4-4be7-8552-5993c9d3ba2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5273644-f8f6-416f-9329-cba455e5185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5273644-f8f6-416f-9329-cba455e5185e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc306dd8-9784-43ab-b845-92a478de1512', 'volume_name': 'volume-dc306dd8-9784-43ab-b845-92a478de1512', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d0595b-9978-47b1-ba25-6623bbb33f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d0595b-9978-47b1-ba25-6623bbb33f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a2c662-72b3-40e7-8fc9-fb78a7899a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:56 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Volume dc306dd8-9784-43ab-b845-92a478de1512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc306dd8-9784-43ab-b845-92a478de1512', 'volume_size': 1}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc306dd8-9784-43ab-b845-92a478de1512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c4bc265e3e4975a71c9630c288bed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:56Z,use_quota=True,user_id='df76b96761a2458cb89fd70156ac6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Creating volume dc306dd8-9784-43ab-b845-92a478de1512 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:25:56 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-dc306dd8-9784-43ab-b845-92a478de1512 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:56 devstack quobyte-client[83236]: System call of process 92911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:25:56 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=83, name=volume-dc306dd8-9784-43ab-b845-92a478de1512, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-dc306dd8-9784-43ab-b845-92a478de1512 1073741824" returned: 0 in 0.529s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-dc306dd8-9784-43ab-b845-92a478de1512 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-dc306dd8-9784-43ab-b845-92a478de1512" returned: 0 in 0.142s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] <== create_volume: return (806ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:25:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a2c662-72b3-40e7-8fc9-fb78a7899a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc306dd8-9784-43ab-b845-92a478de1512', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c9dee1-6e01-45c5-8765-5bea2764f845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:57 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Volume volume-dc306dd8-9784-43ab-b845-92a478de1512 (dc306dd8-9784-43ab-b845-92a478de1512): created successfully
Sep 17 15:25:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c9dee1-6e01-45c5-8765-5bea2764f845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:57 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Flow 'volume_create_manager' (fd2b680f-644f-4b3e-b11b-40d7325089d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:57 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-89f7b346-54cb-4a96-95b5-9582154b5490 tempest-CinderUnicodeTest-681596147 None] Created volume successfully.
Sep 17 15:25:59 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Flow 'volume_create_manager' (9cba1d5b-45af-4cfe-9b7b-b8e2a5147a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b18eda-f85d-47fe-8a64-63b6f349cbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b18eda-f85d-47fe-8a64-63b6f349cbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-417634626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b74c301-1747-4f78-bb36-7a8e8dfe163e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c4bc265e3e4975a71c9630c288bed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:59Z,use_quota=True,user_id='df76b96761a2458cb89fd70156ac6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abc5a1e-002f-44c4-a7d0-eeaabf400ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abc5a1e-002f-44c4-a7d0-eeaabf400ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7f4d43-87b7-4b13-ba83-a8f636d03cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7f4d43-87b7-4b13-ba83-a8f636d03cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b74c301-1747-4f78-bb36-7a8e8dfe163e', 'volume_name': 'volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d6268b-df82-403b-a695-4a6082dd424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d6268b-df82-403b-a695-4a6082dd424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf174022-8d6e-4569-80e5-df036eb466e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:25:59 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Volume 9b74c301-1747-4f78-bb36-7a8e8dfe163e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e', 'volume_size': 1}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:25:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-417634626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b74c301-1747-4f78-bb36-7a8e8dfe163e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c4bc265e3e4975a71c9630c288bed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:25:59Z,use_quota=True,user_id='df76b96761a2458cb89fd70156ac6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Creating volume 9b74c301-1747-4f78-bb36-7a8e8dfe163e {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:25:59 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:25:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:00 devstack quobyte-client[83236]: System call of process 92962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:26:00 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=84, name=volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:26:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e 1073741824" returned: 0 in 0.461s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e" returned: 0 in 0.198s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] <== create_volume: return (788ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:26:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf174022-8d6e-4569-80e5-df036eb466e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bf7601-72ab-4ee0-be01-1856a33cc8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:01 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Volume volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e (9b74c301-1747-4f78-bb36-7a8e8dfe163e): created successfully
Sep 17 15:26:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bf7601-72ab-4ee0-be01-1856a33cc8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Flow 'volume_create_manager' (9cba1d5b-45af-4cfe-9b7b-b8e2a5147a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-937eb9ca-b965-4c11-8e54-ac9080525a1a tempest-CinderUnicodeTest-681596147 None] Created volume successfully.
Sep 17 15:26:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Creating offline snapshot 83eff6bf-52a9-40d4-8577-de33460e766c of volume 9b74c301-1747-4f78-bb36-7a8e8dfe163e {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:26:02 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7550b95-36b2-4ef9-bb01-0381ad4405a3]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:02 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Flow 'volume_create_manager' (a2322413-3562-422d-8da2-e0aa454b2e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f2fed1-b038-45fd-8baf-5328cc22063e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f2fed1-b038-45fd-8baf-5328cc22063e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-520570447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8889c446-7097-4465-b6b4-73af54161b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd54b3915cb344c1950ba6fdf2396f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:02Z,use_quota=True,user_id='17efd5c8f4d14a71bb90eedae6e92264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae33b506-7e4e-4aa2-bf5d-0b76078fdbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae33b506-7e4e-4aa2-bf5d-0b76078fdbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef64b5fc-68c9-47c8-90a9-e8017860b658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef64b5fc-68c9-47c8-90a9-e8017860b658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8889c446-7097-4465-b6b4-73af54161b70', 'volume_name': 'volume-8889c446-7097-4465-b6b4-73af54161b70', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4b3eda-7439-493c-aa52-83bd783d4c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4b3eda-7439-493c-aa52-83bd783d4c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c4f1c9-e81b-418e-a69d-b892a24019a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:03 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Volume 8889c446-7097-4465-b6b4-73af54161b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8889c446-7097-4465-b6b4-73af54161b70', 'volume_size': 1}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e" returned: 0 in 0.806s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:03 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=85, name=volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c 1G" returned: 0 in 0.302s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] CMD "qemu-img rebase -u -b volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c" returned: 0 in 0.192s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:26:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c" returned: 0 in 0.107s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c" returned: 0 in 0.147s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.info" returned: 0 in 0.173s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.info" returned: 0 in 0.112s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.794s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-520570447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8889c446-7097-4465-b6b4-73af54161b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd54b3915cb344c1950ba6fdf2396f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:02Z,use_quota=True,user_id='17efd5c8f4d14a71bb90eedae6e92264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Creating volume 8889c446-7097-4465-b6b4-73af54161b70 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:26:05 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8889c446-7097-4465-b6b4-73af54161b70 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:DELETE=10,cinder:SELECT=86,cinder:INSERT=20,cinder:UPDATE=110 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:26:05 devstack quobyte-client[83236]: System call of process 92985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:26:05 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=87, name=volume-8889c446-7097-4465-b6b4-73af54161b70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=116,cinder:SELECT=85,cinder:INSERT=41,cinder:DELETE=9 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:26:05 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-129f642e-c3d1-46aa-a286-640fc8721663 tempest-CinderUnicodeTest-681596147 None] Create snapshot completed successfully
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8889c446-7097-4465-b6b4-73af54161b70 1073741824" returned: 0 in 0.865s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8889c446-7097-4465-b6b4-73af54161b70 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8889c446-7097-4465-b6b4-73af54161b70" returned: 0 in 0.331s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] <== create_volume: return (1296ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:26:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c4f1c9-e81b-418e-a69d-b892a24019a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8889c446-7097-4465-b6b4-73af54161b70', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa436b1-7809-41f7-9cbc-75e0017a25c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:06 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Volume volume-8889c446-7097-4465-b6b4-73af54161b70 (8889c446-7097-4465-b6b4-73af54161b70): created successfully
Sep 17 15:26:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa436b1-7809-41f7-9cbc-75e0017a25c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Flow 'volume_create_manager' (a2322413-3562-422d-8da2-e0aa454b2e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Acquiring lock "cinder-83eff6bf-52a9-40d4-8577-de33460e766c-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:07 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a50fb9cf-811c-44b2-aaf2-540db697ef94 tempest-VolumesTransfersV355Test-2144523495 None] Created volume successfully.
Sep 17 15:26:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Lock "cinder-83eff6bf-52a9-40d4-8577-de33460e766c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.169s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:07 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Acquiring lock "cinder-quobyte-9b74c301-1747-4f78-bb36-7a8e8dfe163e" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Lock "cinder-quobyte-9b74c301-1747-4f78-bb36-7a8e8dfe163e" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Acquiring lock "cinder-quobyte-83eff6bf-52a9-40d4-8577-de33460e766c" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Lock "cinder-quobyte-83eff6bf-52a9-40d4-8577-de33460e766c" acquired by "_delete_snapshot" :: waited 0.092s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Deleting offline snapshot 83eff6bf-52a9-40d4-8577-de33460e766c of volume 9b74c301-1747-4f78-bb36-7a8e8dfe163e {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:26:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] snapshot_file for this snap is: volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:26:07 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b3a20b-8588-4ccf-b1ef-70aea14fc6f9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c" returned: 0 in 0.911s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:26:08 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0b9130-8e54-45e6-8517-8452af68357f]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:08 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2ed8c8be-f9ab-4055-9861-9f765ca670b9 tempest-VolumesTransfersV355Test-677538044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:08 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2ed8c8be-f9ab-4055-9861-9f765ca670b9 tempest-VolumesTransfersV355Test-677538044 None] Transfer volume completed successfully.
Sep 17 15:26:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e" returned: 0 in 0.589s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:09 devstack quobyte-client[83236]: System call of process 93032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:26:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c" returned: 0 in 0.230s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e.83eff6bf-52a9-40d4-8577-de33460e766c" returned: 0 in 0.206s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:09 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Lock "cinder-quobyte-83eff6bf-52a9-40d4-8577-de33460e766c" released by "_delete_snapshot" :: held 2.398s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:09 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Lock "cinder-quobyte-9b74c301-1747-4f78-bb36-7a8e8dfe163e" released by "delete_snapshot" :: held 2.512s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Acquiring lock "cinder-8889c446-7097-4465-b6b4-73af54161b70-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Lock "cinder-8889c446-7097-4465-b6b4-73af54161b70-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:10 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Acquiring lock "cinder-quobyte-8889c446-7097-4465-b6b4-73af54161b70" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Lock "cinder-quobyte-8889c446-7097-4465-b6b4-73af54161b70" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Created reservations ['f839dd7f-83a7-45cc-b8d5-7fbf76bbc230', '0d3dd3da-3bd6-4acb-9c7a-a94f525ccedd', '48c71071-2793-4cc5-ad55-323bb01e0596', '07cd42d6-98aa-4c37-a9d8-956f8273bc63'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9a3857-27e6-409a-a6ab-04aaa59fb350]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8889c446-7097-4465-b6b4-73af54161b70 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:10 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Delete snapshot completed successfully.
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-696dda78-91dd-44f8-8010-4f64e4d5eb6e tempest-CinderUnicodeTest-681596147 None] Lock "cinder-83eff6bf-52a9-40d4-8577-de33460e766c-delete_snapshot" released by "delete_snapshot" :: held 3.640s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8889c446-7097-4465-b6b4-73af54161b70" returned: 0 in 0.547s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8889c446-7097-4465-b6b4-73af54161b70 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8889c446-7097-4465-b6b4-73af54161b70" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:11 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Lock "cinder-quobyte-8889c446-7097-4465-b6b4-73af54161b70" released by "delete_volume" :: held 0.792s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:11 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Acquiring lock "cinder-9b74c301-1747-4f78-bb36-7a8e8dfe163e-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:11 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Lock "cinder-9b74c301-1747-4f78-bb36-7a8e8dfe163e-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:11 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Created reservations ['8d6f331b-7e90-462c-bab0-248ec11df433', 'e624de62-16b7-4c88-a01b-14e2c6d1e115', '53ff00ca-e19b-48c8-a245-985197404098', '2437f784-84bc-4393-b815-ac278163efb5'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:11 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:11 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Acquiring lock "cinder-quobyte-9b74c301-1747-4f78-bb36-7a8e8dfe163e" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:11 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Lock "cinder-quobyte-9b74c301-1747-4f78-bb36-7a8e8dfe163e" acquired by "delete_volume" :: waited 0.022s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:11 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b4680d-a239-4284-a6a7-a7e71d1ac550]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:12 devstack quobyte-client[83236]: System call of process 93040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.539s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e" returned: 0 in 0.929s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:12 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Deleted volume successfully.
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "cinder-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 1.122s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-9b74c301-1747-4f78-bb36-7a8e8dfe163e" returned: 0 in 0.477s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c-delete_volume" acquired by "delete_volume" :: waited 0.255s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a5c0955-dc79-48c8-883e-32eaa18d87e0 tempest-VolumesTransfersV355Test-795946779 None] Lock "cinder-8889c446-7097-4465-b6b4-73af54161b70-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Lock "cinder-quobyte-9b74c301-1747-4f78-bb36-7a8e8dfe163e" released by "delete_volume" :: held 1.907s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:13 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Flow 'volume_create_manager' (bf829088-62a4-4ccd-9a58-bd2809c095ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93884092-783a-4910-8d21-5e1c264fced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93884092-783a-4910-8d21-5e1c264fced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-428022479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a580d9-18b3-4433-b597-0cb33ec28ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd54b3915cb344c1950ba6fdf2396f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:13Z,use_quota=True,user_id='17efd5c8f4d14a71bb90eedae6e92264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026163c9-72e7-43ed-9776-e41abddefaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026163c9-72e7-43ed-9776-e41abddefaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01de4527-d707-4b9c-803c-7127f85cf620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01de4527-d707-4b9c-803c-7127f85cf620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a580d9-18b3-4433-b597-0cb33ec28ec8', 'volume_name': 'volume-03a580d9-18b3-4433-b597-0cb33ec28ec8', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a751e2-d837-4e03-9cff-7301af316f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a751e2-d837-4e03-9cff-7301af316f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2d7e28-7c5d-443b-8877-621208a7aad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:13 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Volume 03a580d9-18b3-4433-b597-0cb33ec28ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a580d9-18b3-4433-b597-0cb33ec28ec8', 'volume_size': 1}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-428022479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a580d9-18b3-4433-b597-0cb33ec28ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd54b3915cb344c1950ba6fdf2396f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:13Z,use_quota=True,user_id='17efd5c8f4d14a71bb90eedae6e92264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Creating volume 03a580d9-18b3-4433-b597-0cb33ec28ec8 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:26:13 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:26:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-03a580d9-18b3-4433-b597-0cb33ec28ec8 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:13 devstack quobyte-client[83236]: System call of process 93047 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:26:13 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=88, name=volume-03a580d9-18b3-4433-b597-0cb33ec28ec8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:26:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "cinder-quobyte-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-03a580d9-18b3-4433-b597-0cb33ec28ec8 1073741824" returned: 0 in 0.541s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-03a580d9-18b3-4433-b597-0cb33ec28ec8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-quobyte-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c" acquired by "delete_volume" :: waited 0.406s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-03a580d9-18b3-4433-b597-0cb33ec28ec8" returned: 0 in 0.409s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] <== create_volume: return (969ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce59b351-4084-4566-a0f5-74caa4ba3191]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:14 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Created reservations ['a35d6764-f2d9-4a23-af76-d316206d78f2', 'd78057db-d42c-44b7-b054-22852097a5f7', '911d1f2d-3353-4947-b838-3aad64432cf1', 'fcd5b49d-fe9e-470d-99e4-ae4692aeb268'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2d7e28-7c5d-443b-8877-621208a7aad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a580d9-18b3-4433-b597-0cb33ec28ec8', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727ef34d-dded-455c-b1b8-8b74934f8c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:15 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Volume volume-03a580d9-18b3-4433-b597-0cb33ec28ec8 (03a580d9-18b3-4433-b597-0cb33ec28ec8): created successfully
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727ef34d-dded-455c-b1b8-8b74934f8c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Flow 'volume_create_manager' (bf829088-62a4-4ccd-9a58-bd2809c095ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c" returned: 0 in 0.587s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:15 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-caefe744-edeb-4d13-8661-becf37da41f9 tempest-VolumesTransfersV355Test-2144523495 None] Created volume successfully.
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c" returned: 0 in 0.312s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-quobyte-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c" released by "delete_volume" :: held 1.052s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Acquiring lock "cinder-03a580d9-18b3-4433-b597-0cb33ec28ec8-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Acquiring lock "cinder-dc306dd8-9784-43ab-b845-92a478de1512-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.432s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:16 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Deleted volume successfully.
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Lock "cinder-03a580d9-18b3-4433-b597-0cb33ec28ec8-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Lock "cinder-dc306dd8-9784-43ab-b845-92a478de1512-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-58c838d9-19a3-47c8-82f0-37bb6dec63e7 tempest-CinderUnicodeTest-681596147 None] Lock "cinder-9b74c301-1747-4f78-bb36-7a8e8dfe163e-delete_volume" released by "delete_volume" :: held 4.990s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Created reservations ['76091933-8792-40e6-8437-87e49fe1da66', 'cf63b437-7a5f-40b6-9e15-75ed62b4fcfa', 'f11cde0d-1369-44bd-835e-9c062052e631', '44fe4636-005d-4d6d-9cb0-40cd2421c654'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:16 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Acquiring lock "cinder-quobyte-03a580d9-18b3-4433-b597-0cb33ec28ec8" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:16 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Acquiring lock "cinder-quobyte-dc306dd8-9784-43ab-b845-92a478de1512" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Lock "cinder-quobyte-03a580d9-18b3-4433-b597-0cb33ec28ec8" acquired by "delete_volume" :: waited 0.033s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aecb54f-7c8d-467e-b4ef-ee1f362896ee]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Lock "cinder-quobyte-dc306dd8-9784-43ab-b845-92a478de1512" acquired by "delete_volume" :: waited 0.047s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-03a580d9-18b3-4433-b597-0cb33ec28ec8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[352b44fa-78ff-4ba6-ac93-8348362f6fa0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-dc306dd8-9784-43ab-b845-92a478de1512 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-03a580d9-18b3-4433-b597-0cb33ec28ec8" returned: 0 in 0.729s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-03a580d9-18b3-4433-b597-0cb33ec28ec8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "cinder-b2c89138-71d1-4447-a00f-da0fa5d0ed24-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-03a580d9-18b3-4433-b597-0cb33ec28ec8" returned: 0 in 0.320s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-dc306dd8-9784-43ab-b845-92a478de1512" returned: 0 in 0.972s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-dc306dd8-9784-43ab-b845-92a478de1512 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.626s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-b2c89138-71d1-4447-a00f-da0fa5d0ed24-delete_volume" acquired by "delete_volume" :: waited 0.311s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:18 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Deleted volume successfully.
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Lock "cinder-quobyte-03a580d9-18b3-4433-b597-0cb33ec28ec8" released by "delete_volume" :: held 1.585s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-dc306dd8-9784-43ab-b845-92a478de1512" returned: 0 in 0.421s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:18 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "cinder-quobyte-b2c89138-71d1-4447-a00f-da0fa5d0ed24" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Lock "cinder-quobyte-dc306dd8-9784-43ab-b845-92a478de1512" released by "delete_volume" :: held 1.682s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef7b500e-aee9-4975-a394-c1737036d239 tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-a045e4c2-fc8b-47e5-94e1-c8aea4ae806c-delete_volume" released by "delete_volume" :: held 4.719s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-quobyte-b2c89138-71d1-4447-a00f-da0fa5d0ed24" acquired by "delete_volume" :: waited 0.060s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fd6e18-fa34-41c0-8550-325b077d3de8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Created reservations ['5a0bccec-2a19-45ff-b5dd-92eebe46b537', 'ba61f8d4-1265-4453-9586-45d8c2b2a4fe', '20678c0f-fd2e-4add-8d1a-3007170e6bee', 'ecebf3ac-8a8d-4c70-86ed-b15aab50b982'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Created reservations ['033a0459-a7d5-44e8-80da-b411cf865658', 'c6ad870c-d793-4b09-92f5-ff304033c16b', '01ec18f9-2732-4067-81fb-6b35340c939c', '91d96fc7-7b2a-4956-a580-6705d1a22125'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:18 devstack quobyte-client[83236]: System call of process 93065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24" returned: 0 in 0.569s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b2c89138-71d1-4447-a00f-da0fa5d0ed24" returned: 0 in 0.184s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-quobyte-b2c89138-71d1-4447-a00f-da0fa5d0ed24" released by "delete_volume" :: held 1.126s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.533s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:19 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Deleted volume successfully.
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-45962193-4217-4b41-9931-f616797633c6 tempest-CinderUnicodeTest-681596147 None] Lock "cinder-dc306dd8-9784-43ab-b845-92a478de1512-delete_volume" released by "delete_volume" :: held 3.901s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Created reservations ['6f8c9d70-976b-4cbe-9b5f-f87451fa2713', '588256d6-6ba6-477a-94d2-8d0b93b72e7d', 'e3f21b60-ca92-4dee-880e-dcdc3b441322', '204bf515-90a7-46e1-a7a9-c958875b5439'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.520s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Deleted volume successfully.
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bd44e9d3-02cf-4e40-a220-31e05bb9a9b2 tempest-VolumesTransfersV355Test-795946779 None] Lock "cinder-03a580d9-18b3-4433-b597-0cb33ec28ec8-delete_volume" released by "delete_volume" :: held 4.280s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.197s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:21 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:21 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Deleted volume successfully.
Sep 17 15:26:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "cinder-c2b881ea-034d-4a4e-b609-47f1eb2068c2-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7c24d68c-1b6d-4e6d-8fbe-492ab858c75f tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-b2c89138-71d1-4447-a00f-da0fa5d0ed24-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-c2b881ea-034d-4a4e-b609-47f1eb2068c2-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:21 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "cinder-quobyte-c2b881ea-034d-4a4e-b609-47f1eb2068c2" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:21 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-quobyte-c2b881ea-034d-4a4e-b609-47f1eb2068c2" acquired by "delete_volume" :: waited 0.015s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:21 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f2f6f8-7b4f-4289-a022-5f481e336b48]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2" returned: 0 in 0.624s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c2b881ea-034d-4a4e-b609-47f1eb2068c2" returned: 0 in 0.145s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:22 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-quobyte-c2b881ea-034d-4a4e-b609-47f1eb2068c2" released by "delete_volume" :: held 0.977s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Created reservations ['8b5ee61b-6bc7-497d-9342-1857d1ddf631', '85f7732b-0435-40d9-92a5-77398f8e04c7', 'da89af8d-effc-4cab-87c5-ae4422a41785', '9ae9c007-1877-4e53-926c-79146066bb35'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.124s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:23 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Deleted volume successfully.
Sep 17 15:26:23 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2fc073c1-6f21-47e9-84d7-83c2fe8aa63f tempest-AttachVolumeTestJSON-570979370 None] Lock "cinder-c2b881ea-034d-4a4e-b609-47f1eb2068c2-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:28 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:26:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Flow 'volume_create_manager' (6b030c24-9c62-45f5-ac18-c466561ae97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eadd25a-a620-4049-903b-d8ebbc2099ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eadd25a-a620-4049-903b-d8ebbc2099ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-382683312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa50808aa1741a589052082c85d1dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:28Z,use_quota=True,user_id='41bac5694da948cdb7dfd7437f7fcf2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441584fb-bea7-4762-8fa4-691f63cbe1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441584fb-bea7-4762-8fa4-691f63cbe1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa97d23c-88f1-4393-a1f4-623992f2c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa97d23c-88f1-4393-a1f4-623992f2c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7', 'volume_name': 'volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38fd016-2d09-4adf-8b53-8801a19009e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38fd016-2d09-4adf-8b53-8801a19009e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bee462-6501-4ccc-9d53-08f707122529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:29 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Volume b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7', 'volume_size': 1}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-382683312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa50808aa1741a589052082c85d1dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:28Z,use_quota=True,user_id='41bac5694da948cdb7dfd7437f7fcf2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Creating volume b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:26:29 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:29 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=89, name=volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7 1073741824" returned: 0 in 0.438s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7" returned: 0 in 0.110s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] <== create_volume: return (640ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:26:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.653s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bee462-6501-4ccc-9d53-08f707122529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4ae6c8-8e61-40f4-a4e2-e075d10ad807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:30 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Volume volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7 (b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7): created successfully
Sep 17 15:26:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4ae6c8-8e61-40f4-a4e2-e075d10ad807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Flow 'volume_create_manager' (6b030c24-9c62-45f5-ac18-c466561ae97f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:30 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-7c120bc5-2a7d-47cb-87da-f91a3c4454e9 tempest-VolumesTransfersV357Test-1967916706 None] Created volume successfully.
Sep 17 15:26:31 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-01d7a7dc-0b7d-4229-a51d-9eced997f8ef tempest-VolumesTransfersV357Test-1539548758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:31 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-01d7a7dc-0b7d-4229-a51d-9eced997f8ef tempest-VolumesTransfersV357Test-1539548758 None] Transfer volume completed successfully.
Sep 17 15:26:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Acquiring lock "cinder-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Lock "cinder-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:32 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Acquiring lock "cinder-quobyte-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Lock "cinder-quobyte-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:32 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0ee600-c769-4a5a-9fc0-1c513ca0cca0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7" returned: 0 in 0.504s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7" returned: 0 in 0.144s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Lock "cinder-quobyte-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7" released by "delete_volume" :: held 0.846s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Created reservations ['796813e6-0b75-425b-8dd1-f1655dc095e2', 'b03e95db-1647-4838-825f-87d13e051800', '45c9b3af-ba3b-41fa-b891-e6fa094fdc54', '564df4eb-ca9d-4ea0-8b14-2cdffbeca0e4'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.135s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Deleted volume successfully.
Sep 17 15:26:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-6c5d0316-e7df-4aa6-a33f-378cac0f4f71 tempest-VolumesTransfersV357Test-1369046634 None] Lock "cinder-b5b1d7d9-0cdc-4631-9c65-a7cbe688f1a7-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:35 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Flow 'volume_create_manager' (77a57823-e73a-4ef4-823e-3be47b71c32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec43219-f946-47cf-8bd8-cec6228f9ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec43219-f946-47cf-8bd8-cec6228f9ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1841120045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafe56dc-3a6f-445b-a964-b0caa331c76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa50808aa1741a589052082c85d1dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:35Z,use_quota=True,user_id='41bac5694da948cdb7dfd7437f7fcf2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67bd584-3132-4b27-8a19-d1f039863fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67bd584-3132-4b27-8a19-d1f039863fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8768f7e4-ae3d-4154-98a8-540c290aa3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8768f7e4-ae3d-4154-98a8-540c290aa3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eafe56dc-3a6f-445b-a964-b0caa331c76f', 'volume_name': 'volume-eafe56dc-3a6f-445b-a964-b0caa331c76f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dade604-1e67-435f-82a4-a86925b9df92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dade604-1e67-435f-82a4-a86925b9df92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c8a7d5-b7f6-4946-8134-f8ec2a8e0ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:35 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Volume eafe56dc-3a6f-445b-a964-b0caa331c76f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eafe56dc-3a6f-445b-a964-b0caa331c76f', 'volume_size': 1}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1841120045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafe56dc-3a6f-445b-a964-b0caa331c76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa50808aa1741a589052082c85d1dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:35Z,use_quota=True,user_id='41bac5694da948cdb7dfd7437f7fcf2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Creating volume eafe56dc-3a6f-445b-a964-b0caa331c76f {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:26:35 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:26:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eafe56dc-3a6f-445b-a964-b0caa331c76f 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:35 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=90, name=volume-eafe56dc-3a6f-445b-a964-b0caa331c76f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:26:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eafe56dc-3a6f-445b-a964-b0caa331c76f 1073741824" returned: 0 in 0.381s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eafe56dc-3a6f-445b-a964-b0caa331c76f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eafe56dc-3a6f-445b-a964-b0caa331c76f" returned: 0 in 0.119s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] <== create_volume: return (579ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:26:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.596s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c8a7d5-b7f6-4946-8134-f8ec2a8e0ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eafe56dc-3a6f-445b-a964-b0caa331c76f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af4afce-807b-420e-99b0-0c42e95c7061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:36 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Volume volume-eafe56dc-3a6f-445b-a964-b0caa331c76f (eafe56dc-3a6f-445b-a964-b0caa331c76f): created successfully
Sep 17 15:26:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af4afce-807b-420e-99b0-0c42e95c7061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Flow 'volume_create_manager' (77a57823-e73a-4ef4-823e-3be47b71c32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:36 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-5e470420-4760-472a-88ba-718f00f2a81a tempest-VolumesTransfersV357Test-1967916706 None] Created volume successfully.
Sep 17 15:26:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Acquiring lock "cinder-eafe56dc-3a6f-445b-a964-b0caa331c76f-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Lock "cinder-eafe56dc-3a6f-445b-a964-b0caa331c76f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:38 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Acquiring lock "cinder-quobyte-eafe56dc-3a6f-445b-a964-b0caa331c76f" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:26:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Lock "cinder-quobyte-eafe56dc-3a6f-445b-a964-b0caa331c76f" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:26:38 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0af100-61d8-4d81-90a7-5d903f8a0176]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:26:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eafe56dc-3a6f-445b-a964-b0caa331c76f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:38 devstack quobyte-client[83236]: System call of process 93095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:26:38 devstack quobyte-client[83236]: System call of process 93095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:26:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eafe56dc-3a6f-445b-a964-b0caa331c76f" returned: 0 in 0.514s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eafe56dc-3a6f-445b-a964-b0caa331c76f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-eafe56dc-3a6f-445b-a964-b0caa331c76f" returned: 0 in 0.151s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Lock "cinder-quobyte-eafe56dc-3a6f-445b-a964-b0caa331c76f" released by "delete_volume" :: held 0.846s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Created reservations ['99b96d04-64a1-4800-98a9-ac43892b010d', '3a591ecd-96dc-4c6e-81fd-0d4fad038944', '6fc11cc8-7ff7-4d5f-8857-ed1827194e3e', '225dc359-9e96-43c4-85b1-3cfa35b47f11'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:39 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:26:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Deleted volume successfully.
Sep 17 15:26:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fbd7787f-3cf4-4d15-948f-a5e6487981f5 tempest-VolumesTransfersV357Test-1369046634 None] Lock "cinder-eafe56dc-3a6f-445b-a964-b0caa331c76f-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:26:49 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:DELETE=6,cinder:UPDATE=93,cinder:SELECT=59,cinder:INSERT=18 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:26:49 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=78,cinder:DELETE=8,cinder:SELECT=49,cinder:INSERT=22 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:26:50 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Flow 'volume_create_manager' (32274864-f29a-4f50-8a37-0b2050d575dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bc85cd-ab52-4919-972e-498a35d3e8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bc85cd-ab52-4919-972e-498a35d3e8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-470368953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1bc682-6c98-4ce0-9174-c992069b3498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f14956977e64a488d1f13e7994a7b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:50Z,use_quota=True,user_id='c78ad4a86cf348e18d2c978e34ebe45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d565464a-b069-4450-a4f3-59537fc447e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d565464a-b069-4450-a4f3-59537fc447e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e0e4e9-0954-4c7d-8ae3-c348145c176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e0e4e9-0954-4c7d-8ae3-c348145c176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1bc682-6c98-4ce0-9174-c992069b3498', 'volume_name': 'volume-1b1bc682-6c98-4ce0-9174-c992069b3498', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249d834b-887e-49f3-9b10-3fa5fd9ab68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249d834b-887e-49f3-9b10-3fa5fd9ab68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db819d3-0af9-4710-933e-384615e426fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:50 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Volume 1b1bc682-6c98-4ce0-9174-c992069b3498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1bc682-6c98-4ce0-9174-c992069b3498', 'volume_size': 1}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-470368953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1bc682-6c98-4ce0-9174-c992069b3498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f14956977e64a488d1f13e7994a7b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:26:50Z,use_quota=True,user_id='c78ad4a86cf348e18d2c978e34ebe45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Creating volume 1b1bc682-6c98-4ce0-9174-c992069b3498 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:26:50 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1b1bc682-6c98-4ce0-9174-c992069b3498 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:50 devstack quobyte-client[83236]: System call of process 93103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:26:50 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=91, name=volume-1b1bc682-6c98-4ce0-9174-c992069b3498, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1b1bc682-6c98-4ce0-9174-c992069b3498 1073741824" returned: 0 in 0.336s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1b1bc682-6c98-4ce0-9174-c992069b3498 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:26:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1b1bc682-6c98-4ce0-9174-c992069b3498" returned: 0 in 0.085s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:26:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] <== create_volume: return (486ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:26:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.502s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:26:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db819d3-0af9-4710-933e-384615e426fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1bc682-6c98-4ce0-9174-c992069b3498', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f85694-64c6-40a6-9449-5a226cac4892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:26:51 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Volume volume-1b1bc682-6c98-4ce0-9174-c992069b3498 (1b1bc682-6c98-4ce0-9174-c992069b3498): created successfully
Sep 17 15:26:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f85694-64c6-40a6-9449-5a226cac4892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:26:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Flow 'volume_create_manager' (32274864-f29a-4f50-8a37-0b2050d575dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:26:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a2f4b43e-44a9-4104-af23-314f4b7b6f11 tempest-VolumesNegativeTest-425092356 None] Created volume successfully.
Sep 17 15:27:01 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:27:01 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:27:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:27:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:27:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:27:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:27:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:27:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.118s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:27:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.560s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:13 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:27:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Acquiring lock "cinder-1b1bc682-6c98-4ce0-9174-c992069b3498-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Lock "cinder-1b1bc682-6c98-4ce0-9174-c992069b3498-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:27:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Acquiring lock "cinder-quobyte-1b1bc682-6c98-4ce0-9174-c992069b3498" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Lock "cinder-quobyte-1b1bc682-6c98-4ce0-9174-c992069b3498" acquired by "delete_volume" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed3ed26-c5ea-429d-9d17-7f30a63c8c46]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1b1bc682-6c98-4ce0-9174-c992069b3498 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1b1bc682-6c98-4ce0-9174-c992069b3498" returned: 0 in 0.441s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1b1bc682-6c98-4ce0-9174-c992069b3498 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1b1bc682-6c98-4ce0-9174-c992069b3498" returned: 0 in 0.115s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Lock "cinder-quobyte-1b1bc682-6c98-4ce0-9174-c992069b3498" released by "delete_volume" :: held 0.702s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Created reservations ['e12a1cc6-1666-4913-8c3a-e86a5379ab1d', '502253b5-04de-487d-ab9d-972789b2fee4', '6d2ba772-0d57-4fab-bcf6-85fdf05787a0', '5e671e8d-ad8f-4375-820e-ba2c70cf4150'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.110s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:27:37 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Deleted volume successfully.
Sep 17 15:27:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-51bb5f0e-276a-4189-b3d2-0bdd8ffea1ac tempest-VolumesNegativeTest-425092356 None] Lock "cinder-1b1bc682-6c98-4ce0-9174-c992069b3498-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:40 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:27:40 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:27:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Flow 'volume_create_manager' (1b901e73-2d4a-4cee-8d85-e201e1ffa7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:27:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32182de3-ef2c-4519-b7cb-a5f4f05012bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32182de3-ef2c-4519-b7cb-a5f4f05012bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1581181080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f732dc67-450f-41d2-bf57-8c113ce66d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08c066dbdfa4d63b7e6f627306cd815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:27:41Z,use_quota=True,user_id='5c9f362ddb68466782bbc3989156adf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a253cd-d9d8-4028-a564-95302279b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a253cd-d9d8-4028-a564-95302279b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c540ab4-f37c-4ae0-aed2-df24aa8a41af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c540ab4-f37c-4ae0-aed2-df24aa8a41af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f732dc67-450f-41d2-bf57-8c113ce66d99', 'volume_name': 'volume-f732dc67-450f-41d2-bf57-8c113ce66d99', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349ba22b-7586-4ddc-9114-9525c41e5838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349ba22b-7586-4ddc-9114-9525c41e5838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a7e3a2-72ed-4b33-9ec8-4e628aadaa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:27:41 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume f732dc67-450f-41d2-bf57-8c113ce66d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f732dc67-450f-41d2-bf57-8c113ce66d99', 'volume_size': 1}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1581181080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f732dc67-450f-41d2-bf57-8c113ce66d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08c066dbdfa4d63b7e6f627306cd815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:27:41Z,use_quota=True,user_id='5c9f362ddb68466782bbc3989156adf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Creating volume f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:27:41 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:41 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=92, name=volume-f732dc67-450f-41d2-bf57-8c113ce66d99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 1073741824" returned: 0 in 0.411s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] <== create_volume: return (559ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.576s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a7e3a2-72ed-4b33-9ec8-4e628aadaa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f732dc67-450f-41d2-bf57-8c113ce66d99', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:27:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90d7e43-e89c-4e1a-921a-0b37d24ddcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:27:42 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume volume-f732dc67-450f-41d2-bf57-8c113ce66d99 (f732dc67-450f-41d2-bf57-8c113ce66d99): created successfully
Sep 17 15:27:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90d7e43-e89c-4e1a-921a-0b37d24ddcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:27:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Flow 'volume_create_manager' (1b901e73-2d4a-4cee-8d85-e201e1ffa7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:27:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-47823307-51be-454f-8cc6-43ec08e74b57 tempest-VolumesSnapshotListTestJSON-1097630345 None] Created volume successfully.
Sep 17 15:27:43 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:27:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:27:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:27:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Creating offline snapshot b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 of volume f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:27:43 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c742e80-b9f6-4962-980f-68f1fc271183]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:44 devstack quobyte-client[83236]: System call of process 93424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:27:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99" returned: 0 in 0.701s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:44 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=93, name=volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:27:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 1G" returned: 0 in 0.289s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f732dc67-450f-41d2-bf57-8c113ce66d99 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img rebase -u -b volume-f732dc67-450f-41d2-bf57-8c113ce66d99 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" returned: 0 in 0.171s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" returned: 0 in 0.123s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" returned: 0 in 0.091s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.info" returned: 0 in 0.107s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.info" returned: 0 in 0.132s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:27:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-0d7cc0e4-9413-438f-9b6d-a1da212a5329 tempest-VolumesSnapshotListTestJSON-1097630345 None] Create snapshot completed successfully
Sep 17 15:27:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:27:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:27:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:27:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Creating offline snapshot 6ea79c8e-91b4-4e13-9ab9-757e32147b99 of volume f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:27:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[877cf946-cc55-4493-96d6-cbd1a4e24460]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:47 devstack quobyte-client[83236]: System call of process 93438 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:27:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" returned: 0 in 0.440s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f732dc67-450f-41d2-bf57-8c113ce66d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:27:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:47 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=95, name=volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:27:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 1G" returned: 0 in 0.270s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:47 devstack quobyte-client[83236]: System call of process 93444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:27:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img rebase -u -b volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99" returned: 0 in 0.167s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:27:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99" returned: 0 in 0.098s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:27:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99" returned: 0 in 0.090s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.392s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:27:48 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ef42a35e-8402-4849-b7b1-17b3915b9892 tempest-VolumesSnapshotListTestJSON-1097630345 None] Create snapshot completed successfully
Sep 17 15:27:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:27:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:27:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:27:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Creating offline snapshot c27e88c5-1e28-4214-a219-562b3cc090f2 of volume f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:27:49 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab31b0d9-0d71-466f-bdec-b900e6a4dbf4]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99" returned: 0 in 0.391s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f732dc67-450f-41d2-bf57-8c113ce66d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:27:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:50 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=96, name=volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 1G" returned: 0 in 0.280s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img rebase -u -b volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2" returned: 0 in 0.143s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2" returned: 0 in 0.094s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.227s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:27:50 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a1d04a19-f4de-48cd-a248-b372dd48fad6 tempest-VolumesSnapshotListTestJSON-1097630345 None] Create snapshot completed successfully
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-c27e88c5-1e28-4214-a219-562b3cc090f2-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-c27e88c5-1e28-4214-a219-562b3cc090f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:52 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-quobyte-c27e88c5-1e28-4214-a219-562b3cc090f2" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-c27e88c5-1e28-4214-a219-562b3cc090f2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Deleting offline snapshot c27e88c5-1e28-4214-a219-562b3cc090f2 of volume f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] snapshot_file for this snap is: volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d0263-21ee-47ed-9a97-f3689e44ece9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2" returned: 0 in 0.348s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f732dc67-450f-41d2-bf57-8c113ce66d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ac9de4-0903-4f2f-9aea-f5d909f3d905]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99" returned: 0 in 0.367s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f732dc67-450f-41d2-bf57-8c113ce66d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:27:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:53 devstack quobyte-client[83236]: System call of process 93466 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:27:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2" returned: 0 in 0.263s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.c27e88c5-1e28-4214-a219-562b3cc090f2" returned: 0 in 0.096s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-c27e88c5-1e28-4214-a219-562b3cc090f2" released by "_delete_snapshot" :: held 1.320s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" released by "delete_snapshot" :: held 1.345s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Created reservations ['07021f98-aa09-4bca-b7c2-5b39b5f85f05', '2e3003f5-0b47-43a7-b252-0d64f04067c3', 'b206dfa1-ea20-44ba-85dc-e6421fbea7d4', 'a979d6cb-6d49-4875-bdf7-87c61a81ce17'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:27:54 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Delete snapshot completed successfully.
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4e4e437d-190d-4c36-bf74-5fa7c96aaaf5 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-c27e88c5-1e28-4214-a219-562b3cc090f2-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-6ea79c8e-91b4-4e13-9ab9-757e32147b99-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-6ea79c8e-91b4-4e13-9ab9-757e32147b99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:54 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-quobyte-6ea79c8e-91b4-4e13-9ab9-757e32147b99" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-6ea79c8e-91b4-4e13-9ab9-757e32147b99" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Deleting offline snapshot 6ea79c8e-91b4-4e13-9ab9-757e32147b99 of volume f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] snapshot_file for this snap is: volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfbbc81-ce50-4277-b5fa-62aefe5ec7ee]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99" returned: 0 in 0.368s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f732dc67-450f-41d2-bf57-8c113ce66d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23b9dd9-7760-4aa6-a0f5-6212460e25e7]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" returned: 0 in 0.359s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f732dc67-450f-41d2-bf57-8c113ce66d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:55 devstack quobyte-client[83236]: System call of process 93477 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99" returned: 0 in 0.186s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.6ea79c8e-91b4-4e13-9ab9-757e32147b99" returned: 0 in 0.099s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-6ea79c8e-91b4-4e13-9ab9-757e32147b99" released by "_delete_snapshot" :: held 1.272s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" released by "delete_snapshot" :: held 1.293s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Created reservations ['d21ea108-e3e1-41a4-b41d-d40b7bfce743', '0ef1d2f3-c66c-42ed-a9d1-c23f93faeeae', '5659f172-19eb-44e5-9a53-693f6160d5e4', 'c628fff7-027a-4d42-976d-ee6bbf12dc6e'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:27:56 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Delete snapshot completed successfully.
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-235b06c6-807a-4681-a344-ba6f20f79b54 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-6ea79c8e-91b4-4e13-9ab9-757e32147b99-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:56 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-quobyte-b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Deleting offline snapshot b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 of volume f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] snapshot_file for this snap is: volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d358531-8c04-41c9-afaa-7ac6de2e8cc4]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" returned: 0 in 0.412s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f732dc67-450f-41d2-bf57-8c113ce66d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:27:57 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f315880-3c14-4928-9820-b6358b6b8474]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99" returned: 0 in 0.429s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:57 devstack quobyte-client[83236]: System call of process 93487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:27:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" returned: 0 in 0.199s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99.b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" returned: 0 in 0.089s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5" released by "_delete_snapshot" :: held 1.422s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" released by "delete_snapshot" :: held 1.468s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:58 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Created reservations ['5e1e0163-052a-4a77-ac49-675ca137ab21', '7e0985f2-fb8f-4866-bccd-419e027f22a2', '615d2d45-f586-463c-8b12-6d95e026beae', '01533d5e-12ce-467c-982a-b2ac10650bf9'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:27:58 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Delete snapshot completed successfully.
Sep 17 15:27:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3c7abd61-4446-419c-9269-dfc50756653b tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-b6b8ebb7-ab5b-4c0e-9a82-91d1103f3dc5-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-f732dc67-450f-41d2-bf57-8c113ce66d99-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-f732dc67-450f-41d2-bf57-8c113ce66d99-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:59 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" acquired by "delete_volume" :: waited 0.021s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5fd8d-176d-453d-b86f-bc8c847802a7]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99" returned: 0 in 0.509s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f732dc67-450f-41d2-bf57-8c113ce66d99" returned: 0 in 0.092s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:27:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-quobyte-f732dc67-450f-41d2-bf57-8c113ce66d99" released by "delete_volume" :: held 0.788s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Created reservations ['ebcd6182-81f8-47fd-9463-07d5e543ebe9', '22b8df40-cef6-4fdf-8be4-a815ad364ce8', '5789a59d-6c92-4449-8122-27e9caa09567', '45e40dcb-e7f0-42b7-acca-6a7b47938a74'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.090s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:28:00 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Deleted volume successfully.
Sep 17 15:28:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3eb966d4-29d4-4508-ade2-a67d477ad061 tempest-VolumesSnapshotListTestJSON-1097630345 None] Lock "cinder-f732dc67-450f-41d2-bf57-8c113ce66d99-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:28:10 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=47,cinder:SELECT=33,cinder:INSERT=9,cinder:DELETE=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:28:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:28:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:28:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:28:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:28:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:28:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:28:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:28:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.174s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:28:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:28:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=26,cinder:INSERT=11,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:28:22 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Flow 'volume_create_manager' (bea5aae2-3942-4f90-9774-7b0962694c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff96f16-7a57-4ee1-83b9-757a5e461be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff96f16-7a57-4ee1-83b9-757a5e461be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-915179247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c15291-ba69-46a3-8d9b-f494ec099100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec55e3c264401c81c06d3fc6fd9e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:28:22Z,use_quota=True,user_id='665b7ae859ea47a8a2a4b582ac2ec9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c96a648-e583-4abc-b26b-4d4055f8a9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c96a648-e583-4abc-b26b-4d4055f8a9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a9b442-f674-41d6-ba01-f1cd6d4d7c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a9b442-f674-41d6-ba01-f1cd6d4d7c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c15291-ba69-46a3-8d9b-f494ec099100', 'volume_name': 'volume-39c15291-ba69-46a3-8d9b-f494ec099100', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc06c70-4b6d-479d-822c-989a33692b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc06c70-4b6d-479d-822c-989a33692b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f4384c-8ef8-4858-baed-421487a944c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:28:22 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Volume 39c15291-ba69-46a3-8d9b-f494ec099100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c15291-ba69-46a3-8d9b-f494ec099100', 'volume_size': 1}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-915179247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c15291-ba69-46a3-8d9b-f494ec099100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec55e3c264401c81c06d3fc6fd9e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:28:22Z,use_quota=True,user_id='665b7ae859ea47a8a2a4b582ac2ec9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Creating volume 39c15291-ba69-46a3-8d9b-f494ec099100 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:28:22 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:28:22 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=97, name=volume-39c15291-ba69-46a3-8d9b-f494ec099100, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100 1073741824" returned: 0 in 0.387s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:28:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:28:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100" returned: 0 in 0.104s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:28:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] <== create_volume: return (560ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:28:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.575s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:28:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f4384c-8ef8-4858-baed-421487a944c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c15291-ba69-46a3-8d9b-f494ec099100', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:28:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86afe618-e89c-483c-83b0-6b8d6241cf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:28:23 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Volume volume-39c15291-ba69-46a3-8d9b-f494ec099100 (39c15291-ba69-46a3-8d9b-f494ec099100): created successfully
Sep 17 15:28:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86afe618-e89c-483c-83b0-6b8d6241cf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:28:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Flow 'volume_create_manager' (bea5aae2-3942-4f90-9774-7b0962694c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:28:23 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-afd4e563-7a3a-491e-8066-6d7812271600 tempest-AttachVolumeNegativeTest-571545870 None] Created volume successfully.
Sep 17 15:28:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-05ad5325-82f6-41e9-9ef0-9ba89ec4a5c6 req-48dff230-dc6a-40b7-9de1-d0d51583795b tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:28:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-05ad5325-82f6-41e9-9ef0-9ba89ec4a5c6 req-48dff230-dc6a-40b7-9de1-d0d51583795b tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:28:28 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc270f75-3949-48f6-97cf-8e61c50c5e59]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:28:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-05ad5325-82f6-41e9-9ef0-9ba89ec4a5c6 req-48dff230-dc6a-40b7-9de1-d0d51583795b tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:28:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-05ad5325-82f6-41e9-9ef0-9ba89ec4a5c6 req-48dff230-dc6a-40b7-9de1-d0d51583795b tempest-AttachVolumeNegativeTest-571545870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100" returned: 0 in 0.528s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:28:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-05ad5325-82f6-41e9-9ef0-9ba89ec4a5c6 req-48dff230-dc6a-40b7-9de1-d0d51583795b tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.588s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:28:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-05ad5325-82f6-41e9-9ef0-9ba89ec4a5c6 req-48dff230-dc6a-40b7-9de1-d0d51583795b tempest-AttachVolumeNegativeTest-571545870 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-39c15291-ba69-46a3-8d9b-f494ec099100', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27b363c9-9ce5-4520-8dd5-9eb57062e848', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:28:29 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-05ad5325-82f6-41e9-9ef0-9ba89ec4a5c6 req-48dff230-dc6a-40b7-9de1-d0d51583795b tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:28:29 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-05ad5325-82f6-41e9-9ef0-9ba89ec4a5c6 req-48dff230-dc6a-40b7-9de1-d0d51583795b tempest-AttachVolumeNegativeTest-571545870 None] attachment_update completed successfully.
Sep 17 15:28:39 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:28:39 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=6 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:29:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:29:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:29:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:29:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:29:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:29:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:29:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:29:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.170s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:29:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:30:01 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:30:01 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Flow 'volume_create_manager' (4da4cb4f-75b3-475e-a9c0-3f4f44a7a360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e28b1d4-0b8d-4a33-b383-37f0d5a2b162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e28b1d4-0b8d-4a33-b383-37f0d5a2b162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1325715704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0c74fd-81c6-479b-899d-4913f3084ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d69f998745f4fcca15ad4ba5e93684d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:30:02Z,use_quota=True,user_id='84626284b4f94e5cbd4678a9a8213c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6d4f59-b065-49d9-9671-c2fa24f29542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6d4f59-b065-49d9-9671-c2fa24f29542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b19b822-e62f-44c6-9a9c-0a50ac7ebd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b19b822-e62f-44c6-9a9c-0a50ac7ebd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f0c74fd-81c6-479b-899d-4913f3084ba5', 'volume_name': 'volume-1f0c74fd-81c6-479b-899d-4913f3084ba5', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c787cb4e-c91b-4be8-a6c2-5b60ba4c1802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c787cb4e-c91b-4be8-a6c2-5b60ba4c1802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017a129f-dd39-4f9f-b21f-14e26ddb2eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:30:02 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Volume 1f0c74fd-81c6-479b-899d-4913f3084ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f0c74fd-81c6-479b-899d-4913f3084ba5', 'volume_size': 1}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1325715704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0c74fd-81c6-479b-899d-4913f3084ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d69f998745f4fcca15ad4ba5e93684d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:30:02Z,use_quota=True,user_id='84626284b4f94e5cbd4678a9a8213c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Creating volume 1f0c74fd-81c6-479b-899d-4913f3084ba5 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:30:02 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:30:02 devstack quobyte-client[83236]: System call of process 94359 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:30:02 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=98, name=volume-1f0c74fd-81c6-479b-899d-4913f3084ba5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5 1073741824" returned: 0 in 0.353s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5" returned: 0 in 0.088s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] <== create_volume: return (539ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.552s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017a129f-dd39-4f9f-b21f-14e26ddb2eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0c74fd-81c6-479b-899d-4913f3084ba5', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5653a73-d636-49fe-a60a-8ea1a1f51918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:30:02 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Volume volume-1f0c74fd-81c6-479b-899d-4913f3084ba5 (1f0c74fd-81c6-479b-899d-4913f3084ba5): created successfully
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5653a73-d636-49fe-a60a-8ea1a1f51918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:30:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Flow 'volume_create_manager' (4da4cb4f-75b3-475e-a9c0-3f4f44a7a360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:30:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-09834fea-3d29-481b-805a-cfd1d4d1ed5e tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Created volume successfully.
Sep 17 15:30:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-c7a9fa97-c0ab-4c9e-8fc4-0dfa2747fc70 req-b83dd9a7-f9cb-453e-87e4-918c3822b4b9 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:30:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-c7a9fa97-c0ab-4c9e-8fc4-0dfa2747fc70 req-b83dd9a7-f9cb-453e-87e4-918c3822b4b9 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:30:07 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e58d95c-f749-4172-b283-72a97143d77d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:30:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-c7a9fa97-c0ab-4c9e-8fc4-0dfa2747fc70 req-b83dd9a7-f9cb-453e-87e4-918c3822b4b9 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:30:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-c7a9fa97-c0ab-4c9e-8fc4-0dfa2747fc70 req-b83dd9a7-f9cb-453e-87e4-918c3822b4b9 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5" returned: 0 in 0.390s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:30:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-c7a9fa97-c0ab-4c9e-8fc4-0dfa2747fc70 req-b83dd9a7-f9cb-453e-87e4-918c3822b4b9 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.443s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:30:08 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-c7a9fa97-c0ab-4c9e-8fc4-0dfa2747fc70 req-b83dd9a7-f9cb-453e-87e4-918c3822b4b9 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-1f0c74fd-81c6-479b-899d-4913f3084ba5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a627a615-1876-4248-94c5-592103e114a0', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:30:08 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-c7a9fa97-c0ab-4c9e-8fc4-0dfa2747fc70 req-b83dd9a7-f9cb-453e-87e4-918c3822b4b9 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:30:08 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-c7a9fa97-c0ab-4c9e-8fc4-0dfa2747fc70 req-b83dd9a7-f9cb-453e-87e4-918c3822b4b9 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] attachment_update completed successfully.
Sep 17 15:30:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:30:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:30:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:30:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:30:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:30:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:30:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:30:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.092s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:30:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:30:18 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:30:18 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:30:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-ca6e304d-1f9c-42d7-8a41-02bdae81e73d req-dc1ddc68-b02e-4e49-9a23-7415be44b226 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:30:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-ca6e304d-1f9c-42d7-8a41-02bdae81e73d req-dc1ddc68-b02e-4e49-9a23-7415be44b226 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:30:36 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-ca6e304d-1f9c-42d7-8a41-02bdae81e73d req-dc1ddc68-b02e-4e49-9a23-7415be44b226 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Terminate volume connection completed successfully.
Sep 17 15:30:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-ca6e304d-1f9c-42d7-8a41-02bdae81e73d req-dc1ddc68-b02e-4e49-9a23-7415be44b226 tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Deleting attachment a627a615-1876-4248-94c5-592103e114a0. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Acquiring lock "cinder-1f0c74fd-81c6-479b-899d-4913f3084ba5-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "cinder-1f0c74fd-81c6-479b-899d-4913f3084ba5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:30:38 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Acquiring lock "cinder-quobyte-1f0c74fd-81c6-479b-899d-4913f3084ba5" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "cinder-quobyte-1f0c74fd-81c6-479b-899d-4913f3084ba5" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4feae-e5ee-48cc-a676-eca7457a1ca0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5" returned: 0 in 0.394s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1f0c74fd-81c6-479b-899d-4913f3084ba5" returned: 0 in 0.115s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:30:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "cinder-quobyte-1f0c74fd-81c6-479b-899d-4913f3084ba5" released by "delete_volume" :: held 0.652s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Created reservations ['fea7fbf5-700f-4ab4-9d16-8ae1c4db7c34', 'd974b435-1a9d-4e90-bdfd-e7d9266c0e0d', '259cc6a6-cd70-486d-b653-02ea39879943', '3f56a7d4-7c57-40e6-8133-8bf95f45a92a'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.116s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:30:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Deleted volume successfully.
Sep 17 15:30:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c13995c9-cdc4-40ed-8243-289e50d4d2ef tempest-TestServerVolumeAttachScenarioOldVersion-469988939 None] Lock "cinder-1f0c74fd-81c6-479b-899d-4913f3084ba5-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:30:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-4426c1e9-7c8b-4d96-bc30-dee5eb7c310b req-953029e7-bc74-463a-889f-7be2a8224108 tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:30:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-4426c1e9-7c8b-4d96-bc30-dee5eb7c310b req-953029e7-bc74-463a-889f-7be2a8224108 tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:30:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-4426c1e9-7c8b-4d96-bc30-dee5eb7c310b req-953029e7-bc74-463a-889f-7be2a8224108 tempest-AttachVolumeNegativeTest-571545870 None] Terminate volume connection completed successfully.
Sep 17 15:30:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-4426c1e9-7c8b-4d96-bc30-dee5eb7c310b req-953029e7-bc74-463a-889f-7be2a8224108 tempest-AttachVolumeNegativeTest-571545870 None] Deleting attachment 27b363c9-9ce5-4520-8dd5-9eb57062e848. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:30:59 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:30:59 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=4,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:31:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:31:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:31:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:31:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:31:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:31:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:31:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:31:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.155s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:31:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:31:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:31:30 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:31:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Flow 'volume_create_manager' (12fd0dce-6c3b-4381-b19b-3537bb201130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:31:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eef18df-6d54-47e4-9194-979812f52597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eef18df-6d54-47e4-9194-979812f52597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-536250809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2406f06-4ae8-42fe-8927-5362a82cdb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1908f3e6bd394e2ab9129bc6ee0bd183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:31:30Z,use_quota=True,user_id='6d752dfdae944fab9a336a31cacab6a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ee120d-5422-45f1-b082-f98ecef96692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ee120d-5422-45f1-b082-f98ecef96692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e1d80b-dc80-43b2-a56b-3da98627503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e1d80b-dc80-43b2-a56b-3da98627503a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2406f06-4ae8-42fe-8927-5362a82cdb60', 'volume_name': 'volume-d2406f06-4ae8-42fe-8927-5362a82cdb60', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7fddee-ae9e-40a2-babf-30a23c03f270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7fddee-ae9e-40a2-babf-30a23c03f270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a09df2-2ec2-494f-9633-8d5ccf015f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume d2406f06-4ae8-42fe-8927-5362a82cdb60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2406f06-4ae8-42fe-8927-5362a82cdb60', 'volume_size': 1}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-536250809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2406f06-4ae8-42fe-8927-5362a82cdb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1908f3e6bd394e2ab9129bc6ee0bd183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:31:30Z,use_quota=True,user_id='6d752dfdae944fab9a336a31cacab6a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Creating volume d2406f06-4ae8-42fe-8927-5362a82cdb60 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:31:31 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:31:31 devstack quobyte-client[83236]: System call of process 94780 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:31:31 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=99, name=volume-d2406f06-4ae8-42fe-8927-5362a82cdb60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:31:31 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Flow 'volume_create_manager' (72b72806-91d0-4e19-aaea-438a5e60da2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430e4e82-3703-43bd-8b16-736c1fd316cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430e4e82-3703-43bd-8b16-736c1fd316cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1552184215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252f7709-4c55-4951-bbd4-bceb2d02ee3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1908f3e6bd394e2ab9129bc6ee0bd183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:31:31Z,use_quota=True,user_id='6d752dfdae944fab9a336a31cacab6a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383f04fe-d071-4f84-a90b-e61c047e7126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383f04fe-d071-4f84-a90b-e61c047e7126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e8b43e-581f-43ed-bda3-5f29d5ed8ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e8b43e-581f-43ed-bda3-5f29d5ed8ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252f7709-4c55-4951-bbd4-bceb2d02ee3b', 'volume_name': 'volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db23399f-48a7-47ab-bc6a-827a0814c31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db23399f-48a7-47ab-bc6a-827a0814c31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82704df-4f69-4be1-aaba-604b7cd6bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:31 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume 252f7709-4c55-4951-bbd4-bceb2d02ee3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b', 'volume_size': 1}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60 1073741824" returned: 0 in 0.801s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:31:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60" returned: 0 in 0.156s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] <== create_volume: return (1007ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.345s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1552184215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252f7709-4c55-4951-bbd4-bceb2d02ee3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1908f3e6bd394e2ab9129bc6ee0bd183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:31:31Z,use_quota=True,user_id='6d752dfdae944fab9a336a31cacab6a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Creating volume 252f7709-4c55-4951-bbd4-bceb2d02ee3b {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:31:32 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:31:32 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=100, name=volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a09df2-2ec2-494f-9633-8d5ccf015f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2406f06-4ae8-42fe-8927-5362a82cdb60', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08c5d1e-4fa8-4e95-a659-8f1b5d26654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b 1073741824" returned: 0 in 0.721s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:31:33 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume volume-d2406f06-4ae8-42fe-8927-5362a82cdb60 (d2406f06-4ae8-42fe-8927-5362a82cdb60): created successfully
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08c5d1e-4fa8-4e95-a659-8f1b5d26654f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Flow 'volume_create_manager' (12fd0dce-6c3b-4381-b19b-3537bb201130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:31:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-4a5ed41d-6697-41fa-aa3e-46b6ce4382a1 tempest-TestServerVolumeAttachmentScenario-281050500 None] Created volume successfully.
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b" returned: 0 in 0.646s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] <== create_volume: return (1415ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82704df-4f69-4be1-aaba-604b7cd6bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43149181-9e5b-40d1-bb60-35eab23c4728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:31:33 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b (252f7709-4c55-4951-bbd4-bceb2d02ee3b): created successfully
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43149181-9e5b-40d1-bb60-35eab23c4728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:31:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Flow 'volume_create_manager' (72b72806-91d0-4e19-aaea-438a5e60da2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:31:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-8151fdc1-c192-4046-b1a6-2d70ab4bf9a3 tempest-TestServerVolumeAttachmentScenario-281050500 None] Created volume successfully.
Sep 17 15:31:43 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:31:43 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=6,cinder:SELECT=1,cinder:DELETE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:32:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:32:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:32:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:32:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:32:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:32:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:32:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:32:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.094s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:32:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:32:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:32:38 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Flow 'volume_create_manager' (63cfb24b-69cc-469a-a8cc-5ce3652e4457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192edf16-8988-479a-ade1-fe20e9b10602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192edf16-8988-479a-ade1-fe20e9b10602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1173552828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a7cd7a-4d7e-4222-b806-c2de389e991c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec55e3c264401c81c06d3fc6fd9e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:32:38Z,use_quota=True,user_id='665b7ae859ea47a8a2a4b582ac2ec9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b1fad4-a1bf-4284-afbb-86afa7f15428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b1fad4-a1bf-4284-afbb-86afa7f15428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f94bdfa-040f-4057-a521-b8241efa28a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f94bdfa-040f-4057-a521-b8241efa28a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a7cd7a-4d7e-4222-b806-c2de389e991c', 'volume_name': 'volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57569867-d4db-4af8-9e47-2951bc32fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57569867-d4db-4af8-9e47-2951bc32fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef13cc9b-fe95-45b4-859f-23a4c3c8784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:32:38 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Volume c8a7cd7a-4d7e-4222-b806-c2de389e991c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c', 'volume_size': 1}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1173552828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a7cd7a-4d7e-4222-b806-c2de389e991c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec55e3c264401c81c06d3fc6fd9e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:32:38Z,use_quota=True,user_id='665b7ae859ea47a8a2a4b582ac2ec9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Creating volume c8a7cd7a-4d7e-4222-b806-c2de389e991c {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:32:38 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:32:38 devstack quobyte-client[83236]: System call of process 95005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:32:38 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=101, name=volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c 1073741824" returned: 0 in 0.316s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:32:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:32:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c" returned: 0 in 0.079s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:32:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] <== create_volume: return (456ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:32:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.468s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:32:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef13cc9b-fe95-45b4-859f-23a4c3c8784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:32:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0137bf-28ad-434d-8495-8e617f9349f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:32:39 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Volume volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c (c8a7cd7a-4d7e-4222-b806-c2de389e991c): created successfully
Sep 17 15:32:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0137bf-28ad-434d-8495-8e617f9349f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:32:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Flow 'volume_create_manager' (63cfb24b-69cc-469a-a8cc-5ce3652e4457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:32:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-82377cce-d015-4f6f-9be6-0eb3f0eaff6a tempest-AttachVolumeNegativeTest-571545870 None] Created volume successfully.
Sep 17 15:32:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-332f6563-b60b-445b-b93c-5a1fe200d802 req-c644a8cb-40bf-49e0-b9cb-daf803f9baaf tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:32:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-332f6563-b60b-445b-b93c-5a1fe200d802 req-c644a8cb-40bf-49e0-b9cb-daf803f9baaf tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:32:44 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92ce30d-8d13-451f-bc6e-048872bd8f2c]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:32:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-332f6563-b60b-445b-b93c-5a1fe200d802 req-c644a8cb-40bf-49e0-b9cb-daf803f9baaf tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:32:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-332f6563-b60b-445b-b93c-5a1fe200d802 req-c644a8cb-40bf-49e0-b9cb-daf803f9baaf tempest-AttachVolumeNegativeTest-571545870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c" returned: 0 in 0.464s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:32:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-332f6563-b60b-445b-b93c-5a1fe200d802 req-c644a8cb-40bf-49e0-b9cb-daf803f9baaf tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.515s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:32:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-332f6563-b60b-445b-b93c-5a1fe200d802 req-c644a8cb-40bf-49e0-b9cb-daf803f9baaf tempest-AttachVolumeNegativeTest-571545870 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3141aafd-378a-46f5-adff-7c451bb4286e', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:32:44 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-332f6563-b60b-445b-b93c-5a1fe200d802 req-c644a8cb-40bf-49e0-b9cb-daf803f9baaf tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:32:45 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-332f6563-b60b-445b-b93c-5a1fe200d802 req-c644a8cb-40bf-49e0-b9cb-daf803f9baaf tempest-AttachVolumeNegativeTest-571545870 None] attachment_update completed successfully.
Sep 17 15:32:55 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:32:55 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-652668b0-bcca-4e0c-9c9a-6e2f26fa4c91 req-4b35e19b-0211-454d-bf75-91b25b31e054 tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-652668b0-bcca-4e0c-9c9a-6e2f26fa4c91 req-4b35e19b-0211-454d-bf75-91b25b31e054 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84796a-4de9-471f-aef4-f03eb63c9ee5]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-652668b0-bcca-4e0c-9c9a-6e2f26fa4c91 req-4b35e19b-0211-454d-bf75-91b25b31e054 tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.232s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-652668b0-bcca-4e0c-9c9a-6e2f26fa4c91 req-4b35e19b-0211-454d-bf75-91b25b31e054 tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60" returned: 0 in 0.473s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-652668b0-bcca-4e0c-9c9a-6e2f26fa4c91 req-4b35e19b-0211-454d-bf75-91b25b31e054 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.621s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:33:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-652668b0-bcca-4e0c-9c9a-6e2f26fa4c91 req-4b35e19b-0211-454d-bf75-91b25b31e054 tempest-TestServerVolumeAttachmentScenario-281050500 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-d2406f06-4ae8-42fe-8927-5362a82cdb60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b201924-9af6-4052-9105-0df5e0f2ef12', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:33:12 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-652668b0-bcca-4e0c-9c9a-6e2f26fa4c91 req-4b35e19b-0211-454d-bf75-91b25b31e054 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:33:13 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-652668b0-bcca-4e0c-9c9a-6e2f26fa4c91 req-4b35e19b-0211-454d-bf75-91b25b31e054 tempest-TestServerVolumeAttachmentScenario-281050500 None] attachment_update completed successfully.
Sep 17 15:33:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-b0ae30e0-757c-43fd-816d-1504e6718347 req-9ba8da76-031b-4fa9-8066-37a39ac73a28 tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:33:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-b0ae30e0-757c-43fd-816d-1504e6718347 req-9ba8da76-031b-4fa9-8066-37a39ac73a28 tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:33:14 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-b0ae30e0-757c-43fd-816d-1504e6718347 req-9ba8da76-031b-4fa9-8066-37a39ac73a28 tempest-AttachVolumeNegativeTest-571545870 None] Terminate volume connection completed successfully.
Sep 17 15:33:14 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-b0ae30e0-757c-43fd-816d-1504e6718347 req-9ba8da76-031b-4fa9-8066-37a39ac73a28 tempest-AttachVolumeNegativeTest-571545870 None] Deleting attachment 3141aafd-378a-46f5-adff-7c451bb4286e. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:33:24 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:33:24 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:33:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-e4b1b193-0e1c-43e0-b5fc-48d5ca016cbf req-28264534-5c3a-4ff9-95cc-7861bb346c9d tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:33:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-e4b1b193-0e1c-43e0-b5fc-48d5ca016cbf req-28264534-5c3a-4ff9-95cc-7861bb346c9d tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:33:25 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e8fc0-b727-4cc7-8413-c6e6a04b72f9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:33:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-e4b1b193-0e1c-43e0-b5fc-48d5ca016cbf req-28264534-5c3a-4ff9-95cc-7861bb346c9d tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:33:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-e4b1b193-0e1c-43e0-b5fc-48d5ca016cbf req-28264534-5c3a-4ff9-95cc-7861bb346c9d tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b" returned: 0 in 0.430s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:33:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-e4b1b193-0e1c-43e0-b5fc-48d5ca016cbf req-28264534-5c3a-4ff9-95cc-7861bb346c9d tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.487s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:33:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-e4b1b193-0e1c-43e0-b5fc-48d5ca016cbf req-28264534-5c3a-4ff9-95cc-7861bb346c9d tempest-TestServerVolumeAttachmentScenario-281050500 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '160d2ff9-62d3-4056-a21b-5d7f5bf33324', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:33:25 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-e4b1b193-0e1c-43e0-b5fc-48d5ca016cbf req-28264534-5c3a-4ff9-95cc-7861bb346c9d tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:33:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-e4b1b193-0e1c-43e0-b5fc-48d5ca016cbf req-28264534-5c3a-4ff9-95cc-7861bb346c9d tempest-TestServerVolumeAttachmentScenario-281050500 None] attachment_update completed successfully.
Sep 17 15:33:36 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:33:36 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:33:54 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-87bc6324-b00a-48d0-8a6b-3ef51fdcabf3 req-f23a822d-1f90-40ca-9b20-f8eb16d2b551 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:33:54 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-87bc6324-b00a-48d0-8a6b-3ef51fdcabf3 req-f23a822d-1f90-40ca-9b20-f8eb16d2b551 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:33:54 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-87bc6324-b00a-48d0-8a6b-3ef51fdcabf3 req-f23a822d-1f90-40ca-9b20-f8eb16d2b551 tempest-TestServerVolumeAttachmentScenario-281050500 None] Terminate volume connection completed successfully.
Sep 17 15:33:54 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-87bc6324-b00a-48d0-8a6b-3ef51fdcabf3 req-f23a822d-1f90-40ca-9b20-f8eb16d2b551 tempest-TestServerVolumeAttachmentScenario-281050500 None] Deleting attachment 160d2ff9-62d3-4056-a21b-5d7f5bf33324. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:34:04 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:34:04 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:34:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:34:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:34:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:34:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:34:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:34:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:34:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:34:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.124s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:34:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:34:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:34:18 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-f271952e-7e2e-40ea-8c2b-48038bf25559 req-41c20f2b-556b-4fdf-bc81-f1db8f36a4ad tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:34:18 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-f271952e-7e2e-40ea-8c2b-48038bf25559 req-41c20f2b-556b-4fdf-bc81-f1db8f36a4ad tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:34:18 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-f271952e-7e2e-40ea-8c2b-48038bf25559 req-41c20f2b-556b-4fdf-bc81-f1db8f36a4ad tempest-TestServerVolumeAttachmentScenario-281050500 None] Terminate volume connection completed successfully.
Sep 17 15:34:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-f271952e-7e2e-40ea-8c2b-48038bf25559 req-41c20f2b-556b-4fdf-bc81-f1db8f36a4ad tempest-TestServerVolumeAttachmentScenario-281050500 None] Deleting attachment 5b201924-9af6-4052-9105-0df5e0f2ef12. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:34:28 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:34:28 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "cinder-252f7709-4c55-4951-bbd4-bceb2d02ee3b-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "cinder-252f7709-4c55-4951-bbd4-bceb2d02ee3b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:34:31 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "cinder-quobyte-252f7709-4c55-4951-bbd4-bceb2d02ee3b" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "cinder-quobyte-252f7709-4c55-4951-bbd4-bceb2d02ee3b" acquired by "delete_volume" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e246170-bd9d-448a-9ab3-d509dfd0d6d1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b" returned: 0 in 0.409s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-252f7709-4c55-4951-bbd4-bceb2d02ee3b" returned: 0 in 0.091s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:34:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "cinder-quobyte-252f7709-4c55-4951-bbd4-bceb2d02ee3b" released by "delete_volume" :: held 0.654s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Created reservations ['c6840ab7-b19c-4835-a199-c93a0f86ef7c', '72560123-1aae-46ed-a239-f17770456bc5', '1d4d5134-89f9-490f-b1f8-f54228c10eca', '73f864f5-359a-4a7c-8207-72db3dc7d95e'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.078s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:34:32 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Deleted volume successfully.
Sep 17 15:34:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e7211d4c-4ce3-4922-ab51-618cb5f5280b tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "cinder-252f7709-4c55-4951-bbd4-bceb2d02ee3b-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:34:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "cinder-d2406f06-4ae8-42fe-8927-5362a82cdb60-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:34:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "cinder-d2406f06-4ae8-42fe-8927-5362a82cdb60-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:34:33 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:34:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "cinder-quobyte-d2406f06-4ae8-42fe-8927-5362a82cdb60" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:34:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "cinder-quobyte-d2406f06-4ae8-42fe-8927-5362a82cdb60" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:34:33 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ea863-35e6-4552-82dd-c217793cfd97]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:34:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:34:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60" returned: 0 in 0.384s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:34:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-d2406f06-4ae8-42fe-8927-5362a82cdb60" returned: 0 in 0.107s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "cinder-quobyte-d2406f06-4ae8-42fe-8927-5362a82cdb60" released by "delete_volume" :: held 0.632s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Created reservations ['84f52fd3-9b62-409f-baac-3c49f325bf2f', '669345d1-057b-4ac8-bd00-0f26a62f3521', 'dcac821b-1748-4107-8579-7c1bb0a2b9ad', '691c9494-1ee0-4c6c-8f9e-015309f44b19'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.110s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:34:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Deleted volume successfully.
Sep 17 15:34:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-33d3a27d-943d-4a77-96f7-395f288da462 tempest-TestServerVolumeAttachmentScenario-281050500 None] Lock "cinder-d2406f06-4ae8-42fe-8927-5362a82cdb60-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:34:44 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=9,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:34:44 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=10,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:35:00 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Flow 'volume_create_manager' (4a213944-67cc-44d8-8ee4-fd753e0dd659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b662eaa2-2afd-47f2-9acb-a5c1e9860504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b662eaa2-2afd-47f2-9acb-a5c1e9860504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-345341515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805c2830-f5e1-4044-8d50-e5996fe5938f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec55e3c264401c81c06d3fc6fd9e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:35:00Z,use_quota=True,user_id='665b7ae859ea47a8a2a4b582ac2ec9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3300a5cb-8dea-4dc7-9fbd-50323e3c1e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3300a5cb-8dea-4dc7-9fbd-50323e3c1e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bd4108-78d8-4bc1-bed4-70f470023cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bd4108-78d8-4bc1-bed4-70f470023cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805c2830-f5e1-4044-8d50-e5996fe5938f', 'volume_name': 'volume-805c2830-f5e1-4044-8d50-e5996fe5938f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bfb581-7230-4c5a-82f8-948a0b728e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bfb581-7230-4c5a-82f8-948a0b728e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475dc22f-58a2-422c-85af-3e0247abb491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:35:00 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Volume 805c2830-f5e1-4044-8d50-e5996fe5938f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805c2830-f5e1-4044-8d50-e5996fe5938f', 'volume_size': 1}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-345341515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805c2830-f5e1-4044-8d50-e5996fe5938f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec55e3c264401c81c06d3fc6fd9e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:35:00Z,use_quota=True,user_id='665b7ae859ea47a8a2a4b582ac2ec9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Creating volume 805c2830-f5e1-4044-8d50-e5996fe5938f {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:35:00 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:35:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:00 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=102, name=volume-805c2830-f5e1-4044-8d50-e5996fe5938f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:35:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f 1073741824" returned: 0 in 0.308s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] <== create_volume: return (452ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:35:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.464s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:35:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475dc22f-58a2-422c-85af-3e0247abb491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805c2830-f5e1-4044-8d50-e5996fe5938f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:35:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422364f1-d320-4274-968a-608535430850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:35:01 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Volume volume-805c2830-f5e1-4044-8d50-e5996fe5938f (805c2830-f5e1-4044-8d50-e5996fe5938f): created successfully
Sep 17 15:35:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422364f1-d320-4274-968a-608535430850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:35:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Flow 'volume_create_manager' (4a213944-67cc-44d8-8ee4-fd753e0dd659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:35:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ddd99b93-d8a7-463c-958f-8eef4f7e596b tempest-AttachVolumeNegativeTest-571545870 None] Created volume successfully.
Sep 17 15:35:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-c8b46853-1611-47df-8f79-4aec42f470f7 req-31aae886-6b41-4f5a-af24-1b3119d54cef tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:35:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-c8b46853-1611-47df-8f79-4aec42f470f7 req-31aae886-6b41-4f5a-af24-1b3119d54cef tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:35:05 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a95d7a-e850-4ec7-bbb0-2bcacc3f8f4c]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:35:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-c8b46853-1611-47df-8f79-4aec42f470f7 req-31aae886-6b41-4f5a-af24-1b3119d54cef tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-c8b46853-1611-47df-8f79-4aec42f470f7 req-31aae886-6b41-4f5a-af24-1b3119d54cef tempest-AttachVolumeNegativeTest-571545870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f" returned: 0 in 0.377s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-c8b46853-1611-47df-8f79-4aec42f470f7 req-31aae886-6b41-4f5a-af24-1b3119d54cef tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.430s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:35:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-c8b46853-1611-47df-8f79-4aec42f470f7 req-31aae886-6b41-4f5a-af24-1b3119d54cef tempest-AttachVolumeNegativeTest-571545870 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-805c2830-f5e1-4044-8d50-e5996fe5938f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6055dc08-4b09-4003-ab6f-a4ec44b0fad4', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:35:05 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-c8b46853-1611-47df-8f79-4aec42f470f7 req-31aae886-6b41-4f5a-af24-1b3119d54cef tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:35:06 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-c8b46853-1611-47df-8f79-4aec42f470f7 req-31aae886-6b41-4f5a-af24-1b3119d54cef tempest-AttachVolumeNegativeTest-571545870 None] attachment_update completed successfully.
Sep 17 15:35:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:35:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:35:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:35:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:35:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:35:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:35:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.081s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:35:15 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:35:16 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:35:33 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-cdbdea4d-b1c4-49bd-83b4-edddf192177d req-6544fc36-835e-4e0e-98e1-46fa6abe2418 tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:35:33 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-cdbdea4d-b1c4-49bd-83b4-edddf192177d req-6544fc36-835e-4e0e-98e1-46fa6abe2418 tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:35:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-cdbdea4d-b1c4-49bd-83b4-edddf192177d req-6544fc36-835e-4e0e-98e1-46fa6abe2418 tempest-AttachVolumeNegativeTest-571545870 None] Terminate volume connection completed successfully.
Sep 17 15:35:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-cdbdea4d-b1c4-49bd-83b4-edddf192177d req-6544fc36-835e-4e0e-98e1-46fa6abe2418 tempest-AttachVolumeNegativeTest-571545870 None] Deleting attachment 6055dc08-4b09-4003-ab6f-a4ec44b0fad4. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:35:43 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:35:43 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:35:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "cinder-805c2830-f5e1-4044-8d50-e5996fe5938f-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:35:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-805c2830-f5e1-4044-8d50-e5996fe5938f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:35:44 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:35:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "cinder-quobyte-805c2830-f5e1-4044-8d50-e5996fe5938f" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:35:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-quobyte-805c2830-f5e1-4044-8d50-e5996fe5938f" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:35:44 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[7276cf5d-6ae5-45de-a35b-23adbd125325]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:35:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f" returned: 0 in 0.407s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-805c2830-f5e1-4044-8d50-e5996fe5938f" returned: 0 in 0.098s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-quobyte-805c2830-f5e1-4044-8d50-e5996fe5938f" released by "delete_volume" :: held 0.633s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Created reservations ['df49e17e-5575-4388-94af-01bd54c72a06', '94e32544-81b4-42df-84e1-a65892983ea3', '2ef55ad6-d201-48c4-bf0a-f9508e49a4f4', '6afdd84b-b9f8-42d4-b8f7-44872c21352b'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.129s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:35:45 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Deleted volume successfully.
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "cinder-c8a7cd7a-4d7e-4222-b806-c2de389e991c-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-c8a7cd7a-4d7e-4222-b806-c2de389e991c-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:35:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ff05d35d-196f-4ab8-b864-62fa7526f64b tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-805c2830-f5e1-4044-8d50-e5996fe5938f-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:35:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:35:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "cinder-quobyte-c8a7cd7a-4d7e-4222-b806-c2de389e991c" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:35:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-quobyte-c8a7cd7a-4d7e-4222-b806-c2de389e991c" acquired by "delete_volume" :: waited 0.015s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:35:46 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d52a9f-7089-4b7c-ab7f-d85db0a0f355]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:35:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c" returned: 0 in 0.393s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-c8a7cd7a-4d7e-4222-b806-c2de389e991c" returned: 0 in 0.098s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-quobyte-c8a7cd7a-4d7e-4222-b806-c2de389e991c" released by "delete_volume" :: held 0.653s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:35:46 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Created reservations ['817c463f-8d12-49ff-aa41-33714eccf9c6', 'c3a96f94-273f-4607-a147-96a249faa198', '3304077b-d29e-4f96-bb04-4a896de21887', '7e193003-043d-4b57-987a-f9b81f89cbca'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:35:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:35:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:35:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:35:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:35:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:35:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:47 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:35:47 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Deleted volume successfully.
Sep 17 15:35:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-c69bc69e-5f7c-41ee-b79c-ffdd0129760f tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-c8a7cd7a-4d7e-4222-b806-c2de389e991c-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "cinder-39c15291-ba69-46a3-8d9b-f494ec099100-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-39c15291-ba69-46a3-8d9b-f494ec099100-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:35:48 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "cinder-quobyte-39c15291-ba69-46a3-8d9b-f494ec099100" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-quobyte-39c15291-ba69-46a3-8d9b-f494ec099100" acquired by "delete_volume" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0442e9a9-4ea9-4a93-b2d6-cabe11e3401b]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100" returned: 0 in 0.387s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-39c15291-ba69-46a3-8d9b-f494ec099100" returned: 0 in 0.086s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-quobyte-39c15291-ba69-46a3-8d9b-f494ec099100" released by "delete_volume" :: held 0.632s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Created reservations ['e9a62191-0b87-4e80-bbdc-e98cdbfcd5a1', '5ddcced3-9ad0-452c-877d-90d7e6e14c56', 'ab3e745a-d209-4d19-985f-a633dae34e0d', 'cb6fc057-cadf-4c70-859f-94f501dfc25f'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.106s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:35:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Deleted volume successfully.
Sep 17 15:35:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32837f8e-7ac4-44c8-a827-57dc7cb04bcd tempest-AttachVolumeNegativeTest-571545870 None] Lock "cinder-39c15291-ba69-46a3-8d9b-f494ec099100-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:35:58 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-bdf2eb02-9402-4c3d-b810-fa9bc486e7d8 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:35:58 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-bdf2eb02-9402-4c3d-b810-fa9bc486e7d8 tempest-GroupSnapshotsTest-1890139390 None] Group tempest-GroupSnapshotsTest-Group-1403601081: creating
Sep 17 15:35:58 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-bdf2eb02-9402-4c3d-b810-fa9bc486e7d8 tempest-GroupSnapshotsTest-1890139390 None] Group tempest-GroupSnapshotsTest-Group-1403601081: created successfully
Sep 17 15:35:58 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-bdf2eb02-9402-4c3d-b810-fa9bc486e7d8 tempest-GroupSnapshotsTest-1890139390 None] Create group completed successfully.
Sep 17 15:36:00 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Flow 'volume_create_manager' (93e67281-29cb-4689-93cf-5126ff219497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb7e3c0-21a6-4dcf-85a2-1c5527a63883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb7e3c0-21a6-4dcf-85a2-1c5527a63883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535541086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed605cf4-d49d-46f3-a6cb-e14e832e0a48,host='devstack@QuobyteHD#QuobyteHD',id=8cc6b5f6-a6e3-4858-a2c0-222efb36fc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3774d49b1ac45528b81cba69bf29115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:36:00Z,use_quota=True,user_id='60f703f7e3bf40a68ec265e85efec7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d4cf715-4dfc-4a48-9827-7bf1dbaae386),volume_type_id=5d4cf715-4dfc-4a48-9827-7bf1dbaae386)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d203e7f-494d-4721-b12f-4040a3e7df86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d203e7f-494d-4721-b12f-4040a3e7df86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300850c2-29b3-4da7-b456-40c6e5625836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300850c2-29b3-4da7-b456-40c6e5625836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc6b5f6-a6e3-4858-a2c0-222efb36fc02', 'volume_name': 'volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d413f15-48ed-4da0-96a6-b0f8d0432cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d413f15-48ed-4da0-96a6-b0f8d0432cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39e224b-33a9-471d-adec-7aa218865334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:00 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Volume 8cc6b5f6-a6e3-4858-a2c0-222efb36fc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02', 'volume_size': 1}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ed605cf4-d49d-46f3-a6cb-e14e832e0a48,created_at=2025-09-17T13:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535541086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed605cf4-d49d-46f3-a6cb-e14e832e0a48,host='devstack@QuobyteHD#QuobyteHD',id=8cc6b5f6-a6e3-4858-a2c0-222efb36fc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3774d49b1ac45528b81cba69bf29115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:36:00Z,use_quota=True,user_id='60f703f7e3bf40a68ec265e85efec7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d4cf715-4dfc-4a48-9827-7bf1dbaae386),volume_type_id=5d4cf715-4dfc-4a48-9827-7bf1dbaae386)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Creating volume 8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:36:00 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:00 devstack quobyte-client[83236]: System call of process 96472 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:36:00 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=103, name=volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 1073741824" returned: 0 in 0.328s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" returned: 0 in 0.090s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] <== create_volume: return (485ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:36:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.498s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39e224b-33a9-471d-adec-7aa218865334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbea0be-d6a8-410c-9a90-7d78a9fccbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:01 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Volume volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 (8cc6b5f6-a6e3-4858-a2c0-222efb36fc02): created successfully
Sep 17 15:36:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbea0be-d6a8-410c-9a90-7d78a9fccbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Flow 'volume_create_manager' (93e67281-29cb-4689-93cf-5126ff219497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:36:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f5b43459-299f-484f-b32f-58931259031c tempest-GroupSnapshotsTest-1890139390 None] Created volume successfully.
Sep 17 15:36:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] GroupSnapshot 33e11c72-2fb5-487e-a990-43aa15a24421: creating.
Sep 17 15:36:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Group snapshot 33e11c72-2fb5-487e-a990-43aa15a24421: creating. {{(pid=83214) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 15:36:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Creating offline snapshot 0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 of volume 8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:36:02 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4b9bce-e1f5-48c1-9505-849be4170f0c]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" returned: 0 in 0.384s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:03 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=104, name=volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 1G" returned: 0 in 0.227s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img rebase -u -b volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" returned: 0 in 0.118s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" returned: 0 in 0.091s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.info" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.info" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.380s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:04 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-092cce96-546c-4705-97b4-69f8bf710362 tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 33e11c72-2fb5-487e-a990-43aa15a24421: created successfully
Sep 17 15:36:05 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7-f26824bd-9dcc-4778-9559-6180dad49f22" by "_create_volume_from_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7-f26824bd-9dcc-4778-9559-6180dad49f22" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Creating volume f26824bd-9dcc-4778-9559-6180dad49f22 from snapshot 0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 {{(pid=83214) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-f26824bd-9dcc-4778-9559-6180dad49f22" by "_copy_volume_from_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-f26824bd-9dcc-4778-9559-6180dad49f22" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] snapshot: 0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7, volume: f26824bd-9dcc-4778-9559-6180dad49f22,  {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[43035516-74b5-445d-9a2f-a6e231796ab2]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" returned: 0 in 0.370s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:36:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 15:36:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Creating direct copy from snapshot {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 15:36:06 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdae867c-97fa-4263-9129-7151608d9a31]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" returned: 0 in 0.382s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:06 devstack cinder-volume[83214]: DEBUG cinder.utils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22 not found in is_blk_device check {{(pid=83214) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 15:36:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:06 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=106, name=volume-f26824bd-9dcc-4778-9559-6180dad49f22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:36:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22" returned: 0 in 4.631s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:11 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[197ad0d4-ac3f-4d25-a041-a0788450eb2a]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" returned: 0 in 0.535s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Image conversion details: src /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22 {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:36:12 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Converted 1024.00 MB image at 220.29 MB/s
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-f26824bd-9dcc-4778-9559-6180dad49f22" released by "_copy_volume_from_snapshot" :: held 6.335s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7-f26824bd-9dcc-4778-9559-6180dad49f22" released by "_create_volume_from_snapshot" :: held 6.506s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.581s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.303s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:36:12 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-bc676cf7-22b6-4106-a558-e7567641120f tempest-GroupSnapshotsTest-1890139390 None] Create group from source-snapshot-33e11c72-2fb5-487e-a990-43aa15a24421 completed successfully.
Sep 17 15:36:13 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-f26824bd-9dcc-4778-9559-6180dad49f22" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-f26824bd-9dcc-4778-9559-6180dad49f22" acquired by "delete_volume" :: waited 0.028s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:13 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a48e1f-4e5f-463b-91ec-54ac2ff28a17]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22" returned: 0 in 0.361s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f26824bd-9dcc-4778-9559-6180dad49f22" returned: 0 in 0.084s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:13 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-f26824bd-9dcc-4778-9559-6180dad49f22" released by "delete_volume" :: held 0.616s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['0950c72f-6418-4440-a394-ce0d6d081d4c'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:14 devstack cinder-volume[83214]: WARNING cinder.quota [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-985676374 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-985676374, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:36:14 devstack cinder-volume[83214]: WARNING cinder.quota [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-985676374 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-985676374, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['27dfdcbd-d644-4778-8a2b-6f7c69e0877b', '6a9800b5-ade3-4d85-9a07-2f6445a60950', 'c118656d-ddf8-4edd-9caa-c6bc87ff0f96', '0807289c-7670-47be-9eb0-056989eea875'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:14 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:36:14 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9e64da65-bcc6-4464-aee5-f476f633d410 tempest-GroupSnapshotsTest-1890139390 None] Delete group completed successfully.
Sep 17 15:36:15 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 33e11c72-2fb5-487e-a990-43aa15a24421: deleting
Sep 17 15:36:15 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:15 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 33e11c72-2fb5-487e-a990-43aa15a24421: deleting {{(pid=83214) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 15:36:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Deleting offline snapshot 0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 of volume 8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:36:15 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] snapshot_file for this snap is: volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:36:15 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0a718e-167d-4808-9f28-02c6f9a4b522]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:15 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" returned: 0 in 0.359s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:36:16 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a815567-fe71-46c3-aa81-7620f51c3949]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" returned: 0 in 0.386s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" returned: 0 in 0.178s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02.0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" returned: 0 in 0.085s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-0e6d5aa9-5aeb-4af3-975b-cdfed49b73c7" released by "_delete_snapshot" :: held 1.305s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" released by "delete_snapshot" :: held 1.328s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:17 devstack cinder-volume[83214]: WARNING cinder.quota [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-985676374 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-985676374, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:36:17 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['295d0d0a-f946-4279-a188-3fee98520386', '007d1700-20b5-48ea-8059-8b0f50f53ae5', '9daceec2-4416-4676-89d1-bdc03274c09f', '44d02906-2fdc-488e-a7b9-f6a5fe80434c'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:17 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3faa9274-28b2-4510-9fe4-59f3e8e979a1 tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 33e11c72-2fb5-487e-a990-43aa15a24421: deleted successfully
Sep 17 15:36:17 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" acquired by "delete_volume" :: waited 0.019s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:18 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9184c2ad-c7f5-4085-8de4-d413a0760ff9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" returned: 0 in 0.399s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" returned: 0 in 0.141s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-8cc6b5f6-a6e3-4858-a2c0-222efb36fc02" released by "delete_volume" :: held 0.728s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['e1167032-36e5-46f1-b441-c82154dc15c2'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:19 devstack cinder-volume[83214]: WARNING cinder.db.sqlalchemy.api [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-985676374']
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['112c8419-8ec0-43c5-84d3-18ac127ae8bd', '1267ada8-082e-494d-a52d-5a983fae7dda', '0075f3fd-b656-4567-ba04-17b39ed49937', '9656271c-ff74-4ad4-b803-37dd4ea5b2d0'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.104s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:19 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:36:19 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2b4437f3-8174-45c2-a319-c99260dbc619 tempest-GroupSnapshotsTest-1890139390 None] Delete group completed successfully.
Sep 17 15:36:20 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9b129b5e-76e6-4e48-959b-a257cd7afcea tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9b129b5e-76e6-4e48-959b-a257cd7afcea tempest-GroupSnapshotsTest-1890139390 None] Group tempest-GroupSnapshotsTest-Group-993876765: creating
Sep 17 15:36:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9b129b5e-76e6-4e48-959b-a257cd7afcea tempest-GroupSnapshotsTest-1890139390 None] Group tempest-GroupSnapshotsTest-Group-993876765: created successfully
Sep 17 15:36:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9b129b5e-76e6-4e48-959b-a257cd7afcea tempest-GroupSnapshotsTest-1890139390 None] Create group completed successfully.
Sep 17 15:36:22 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Flow 'volume_create_manager' (d6ae4801-ec7b-4c0f-82f7-0e59b752a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2fb6eb-8d55-40f6-9eca-2ec65846628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2fb6eb-8d55-40f6-9eca-2ec65846628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739449734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0230901e-cb85-4cbc-afd1-720f142e4d8c,host='devstack@QuobyteHD#QuobyteHD',id=51594af0-b97e-4367-a7e8-604106f1d05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3774d49b1ac45528b81cba69bf29115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:36:22Z,use_quota=True,user_id='60f703f7e3bf40a68ec265e85efec7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99f3171-a125-481a-81b1-2ce365966f3e),volume_type_id=b99f3171-a125-481a-81b1-2ce365966f3e)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507aa7fa-fc3f-4037-a4fc-38d0d20e24d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507aa7fa-fc3f-4037-a4fc-38d0d20e24d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8b6d7b-9ebd-475c-a05c-3a173cc83d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8b6d7b-9ebd-475c-a05c-3a173cc83d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51594af0-b97e-4367-a7e8-604106f1d05b', 'volume_name': 'volume-51594af0-b97e-4367-a7e8-604106f1d05b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c0022c-e5b4-4ba3-ae48-93077ef98f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c0022c-e5b4-4ba3-ae48-93077ef98f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0037d7e-bbf3-4aba-ba24-c00ad4d5a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:22 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Volume 51594af0-b97e-4367-a7e8-604106f1d05b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51594af0-b97e-4367-a7e8-604106f1d05b', 'volume_size': 1}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0230901e-cb85-4cbc-afd1-720f142e4d8c,created_at=2025-09-17T13:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739449734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0230901e-cb85-4cbc-afd1-720f142e4d8c,host='devstack@QuobyteHD#QuobyteHD',id=51594af0-b97e-4367-a7e8-604106f1d05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3774d49b1ac45528b81cba69bf29115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:36:22Z,use_quota=True,user_id='60f703f7e3bf40a68ec265e85efec7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99f3171-a125-481a-81b1-2ce365966f3e),volume_type_id=b99f3171-a125-481a-81b1-2ce365966f3e)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Creating volume 51594af0-b97e-4367-a7e8-604106f1d05b {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:36:22 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:22 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=107, name=volume-51594af0-b97e-4367-a7e8-604106f1d05b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b 1073741824" returned: 0 in 0.306s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b" returned: 0 in 0.101s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:36:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.490s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0037d7e-bbf3-4aba-ba24-c00ad4d5a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51594af0-b97e-4367-a7e8-604106f1d05b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b59b36-580f-48a3-be7f-2f2b866391e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:23 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Volume volume-51594af0-b97e-4367-a7e8-604106f1d05b (51594af0-b97e-4367-a7e8-604106f1d05b): created successfully
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b59b36-580f-48a3-be7f-2f2b866391e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Flow 'volume_create_manager' (d6ae4801-ec7b-4c0f-82f7-0e59b752a10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:36:23 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-09089798-ed22-436d-8f6d-e07938c4aeaa tempest-GroupSnapshotsTest-1890139390 None] Created volume successfully.
Sep 17 15:36:23 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Flow 'volume_create_manager' (8d71608d-e5b7-4000-b58b-76b06e90f070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa67209-7cd7-4aa6-abb5-47242b0acc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa67209-7cd7-4aa6-abb5-47242b0acc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1172206970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0230901e-cb85-4cbc-afd1-720f142e4d8c,host='devstack@QuobyteHD#QuobyteHD',id=92adbae3-05f6-43de-aa3e-334d380c1caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3774d49b1ac45528b81cba69bf29115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:36:24Z,use_quota=True,user_id='60f703f7e3bf40a68ec265e85efec7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99f3171-a125-481a-81b1-2ce365966f3e),volume_type_id=b99f3171-a125-481a-81b1-2ce365966f3e)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4142d5ef-7321-49be-838b-110cb12d0f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4142d5ef-7321-49be-838b-110cb12d0f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602c0f43-9aaf-4c4d-b93d-8aaeb8cda51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602c0f43-9aaf-4c4d-b93d-8aaeb8cda51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92adbae3-05f6-43de-aa3e-334d380c1caf', 'volume_name': 'volume-92adbae3-05f6-43de-aa3e-334d380c1caf', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e99be4-4e44-4983-99db-40cc613f35bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e99be4-4e44-4983-99db-40cc613f35bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8470d95-9f32-41b6-b34d-4362b56f66ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:23 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Volume 92adbae3-05f6-43de-aa3e-334d380c1caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92adbae3-05f6-43de-aa3e-334d380c1caf', 'volume_size': 1}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0230901e-cb85-4cbc-afd1-720f142e4d8c,created_at=2025-09-17T13:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1172206970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0230901e-cb85-4cbc-afd1-720f142e4d8c,host='devstack@QuobyteHD#QuobyteHD',id=92adbae3-05f6-43de-aa3e-334d380c1caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3774d49b1ac45528b81cba69bf29115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:36:24Z,use_quota=True,user_id='60f703f7e3bf40a68ec265e85efec7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99f3171-a125-481a-81b1-2ce365966f3e),volume_type_id=b99f3171-a125-481a-81b1-2ce365966f3e)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Creating volume 92adbae3-05f6-43de-aa3e-334d380c1caf {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:36:23 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:36:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:23 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=108, name=volume-92adbae3-05f6-43de-aa3e-334d380c1caf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:36:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf 1073741824" returned: 0 in 0.330s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf" returned: 0 in 0.097s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] <== create_volume: return (495ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:36:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8470d95-9f32-41b6-b34d-4362b56f66ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92adbae3-05f6-43de-aa3e-334d380c1caf', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f8953e-5d7a-46b4-b855-b7a07ac4c0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:24 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Volume volume-92adbae3-05f6-43de-aa3e-334d380c1caf (92adbae3-05f6-43de-aa3e-334d380c1caf): created successfully
Sep 17 15:36:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f8953e-5d7a-46b4-b855-b7a07ac4c0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Flow 'volume_create_manager' (8d71608d-e5b7-4000-b58b-76b06e90f070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:36:24 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-45584a96-66aa-415d-9f07-4fff102c5124 tempest-GroupSnapshotsTest-1890139390 None] Created volume successfully.
Sep 17 15:36:25 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-fd70a203-0895-437a-a513-670088e4a109 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:25 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-fd70a203-0895-437a-a513-670088e4a109 tempest-GroupSnapshotsTest-1890139390 None] Update group completed successfully.
Sep 17 15:36:26 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-915ffbdb-52cb-49e4-b038-9ab495b937fc tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-915ffbdb-52cb-49e4-b038-9ab495b937fc tempest-GroupSnapshotsTest-1890139390 None] Update group completed successfully.
Sep 17 15:36:27 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-69360ef9-1b00-4534-a119-1c0bc89c71f3 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:27 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-69360ef9-1b00-4534-a119-1c0bc89c71f3 tempest-GroupSnapshotsTest-1890139390 None] Update group completed successfully.
Sep 17 15:36:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-cc0ec2d6-bc69-4af7-b33a-0a3945647957 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:28 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-cc0ec2d6-bc69-4af7-b33a-0a3945647957 tempest-GroupSnapshotsTest-1890139390 None] Update group completed successfully.
Sep 17 15:36:29 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] GroupSnapshot 38a30f22-440d-4466-8fb2-30be7edc2ed8: creating.
Sep 17 15:36:29 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Group snapshot 38a30f22-440d-4466-8fb2-30be7edc2ed8: creating. {{(pid=83214) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 15:36:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Creating offline snapshot 314119e7-1da0-43f4-9050-8f11552f8cce of volume 51594af0-b97e-4367-a7e8-604106f1d05b {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed05125-eddb-4c3c-aa83-6ae998c2c0f2]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b" returned: 0 in 0.395s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:30 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=109, name=volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce 1G" returned: 0 in 0.221s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img rebase -u -b volume-51594af0-b97e-4367-a7e8-604106f1d05b -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img rebase -u -b volume-51594af0-b97e-4367-a7e8-604106f1d05b -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce" returned: 0 in 0.122s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce" returned: 0 in 0.081s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:36:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce" returned: 0 in 0.093s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.info" returned: 0 in 0.087s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.info" returned: 0 in 0.081s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.386s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Creating offline snapshot a9255b0f-b654-42d2-9e08-62d529897081 of volume 92adbae3-05f6-43de-aa3e-334d380c1caf {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc99459-c496-4ea5-bd70-c01d27e2a1e9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf" returned: 0 in 0.361s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:32 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=111, name=volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 1G" returned: 0 in 0.234s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img rebase -u -b volume-92adbae3-05f6-43de-aa3e-334d380c1caf -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:32 devstack quobyte-client[83236]: System call of process 96600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img rebase -u -b volume-92adbae3-05f6-43de-aa3e-334d380c1caf -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081" returned: 0 in 0.123s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081" returned: 0 in 0.079s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081" returned: 0 in 0.080s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.info" returned: 0 in 0.087s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.info" returned: 0 in 0.079s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.490s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-594b58e5-8920-4f33-973e-92ca5cf606c0 tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 38a30f22-440d-4466-8fb2-30be7edc2ed8: created successfully
Sep 17 15:36:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 38a30f22-440d-4466-8fb2-30be7edc2ed8: deleting
Sep 17 15:36:34 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 38a30f22-440d-4466-8fb2-30be7edc2ed8: deleting {{(pid=83214) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-51594af0-b97e-4367-a7e8-604106f1d05b" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-51594af0-b97e-4367-a7e8-604106f1d05b" acquired by "delete_snapshot" :: waited 0.062s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-314119e7-1da0-43f4-9050-8f11552f8cce" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-314119e7-1da0-43f4-9050-8f11552f8cce" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Deleting offline snapshot 314119e7-1da0-43f4-9050-8f11552f8cce of volume 51594af0-b97e-4367-a7e8-604106f1d05b {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] snapshot_file for this snap is: volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc010032-69ff-4c1d-aaef-9cb71b9ef50d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce" returned: 0 in 0.354s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51594af0-b97e-4367-a7e8-604106f1d05b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:36:35 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d6bd03-818e-41bb-b4a0-20a922240d74]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b" returned: 0 in 0.377s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce" returned: 0 in 0.192s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b.314119e7-1da0-43f4-9050-8f11552f8cce" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-314119e7-1da0-43f4-9050-8f11552f8cce" released by "_delete_snapshot" :: held 1.302s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-51594af0-b97e-4367-a7e8-604106f1d05b" released by "delete_snapshot" :: held 1.335s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-92adbae3-05f6-43de-aa3e-334d380c1caf" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-92adbae3-05f6-43de-aa3e-334d380c1caf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-a9255b0f-b654-42d2-9e08-62d529897081" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-a9255b0f-b654-42d2-9e08-62d529897081" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Deleting offline snapshot a9255b0f-b654-42d2-9e08-62d529897081 of volume 92adbae3-05f6-43de-aa3e-334d380c1caf {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] snapshot_file for this snap is: volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac99165-6129-4be5-8dca-61c80d8ae073]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081" returned: 0 in 0.370s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92adbae3-05f6-43de-aa3e-334d380c1caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c9288-fcfd-4b72-824b-927d0d55312f]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf" returned: 0 in 0.370s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:37 devstack quobyte-client[83236]: System call of process 96625 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:36:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081" returned: 0 in 0.175s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf.a9255b0f-b654-42d2-9e08-62d529897081" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-a9255b0f-b654-42d2-9e08-62d529897081" released by "_delete_snapshot" :: held 1.285s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-92adbae3-05f6-43de-aa3e-334d380c1caf" released by "delete_snapshot" :: held 1.316s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:37 devstack cinder-volume[83214]: WARNING cinder.quota [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-115897391 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-115897391, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:36:37 devstack cinder-volume[83214]: WARNING cinder.quota [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-115897391 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-115897391, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:36:37 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['d2c25453-03c3-48c6-b21c-c4ec050fdf87', '7725df90-38f8-4458-a0aa-56db47d6b08a', 'faf00ba5-bdfc-4276-932d-af167fb1eb28', '8783fcfd-57ba-42ea-9cf4-303b73450909'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:37 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['5789014e-b597-4714-9465-b39676064c12', '07dc5b7d-59cb-4528-b9ea-fe5405d64acc', '6a002bdf-50b0-4d89-a0c0-109534765f37', '9b94f945-dfd1-4f56-b0d3-9eca7eb4f200'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:38 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e5784006-43f8-4fb0-8611-3a764797dd44 tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 38a30f22-440d-4466-8fb2-30be7edc2ed8: deleted successfully
Sep 17 15:36:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-51594af0-b97e-4367-a7e8-604106f1d05b" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-51594af0-b97e-4367-a7e8-604106f1d05b" acquired by "delete_volume" :: waited 0.035s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cf4834-630e-4abb-8e4a-25f87c091b86]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b" returned: 0 in 0.394s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-51594af0-b97e-4367-a7e8-604106f1d05b" returned: 0 in 0.111s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-51594af0-b97e-4367-a7e8-604106f1d05b" released by "delete_volume" :: held 0.640s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-92adbae3-05f6-43de-aa3e-334d380c1caf" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-92adbae3-05f6-43de-aa3e-334d380c1caf" acquired by "delete_volume" :: waited 0.031s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[802a1f7b-b183-4885-8bfa-767bf133cff8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf" returned: 0 in 0.393s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-92adbae3-05f6-43de-aa3e-334d380c1caf" returned: 0 in 0.093s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-92adbae3-05f6-43de-aa3e-334d380c1caf" released by "delete_volume" :: held 0.644s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:40 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['1f2b0ae3-acfa-444f-8934-74ba2b48fb33'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:40 devstack cinder-volume[83214]: WARNING cinder.quota [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-115897391 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-115897391, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:36:40 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['1c0a197f-277a-43c0-8855-e0eca2308978', 'fa64da76-2529-4c73-853f-9507605742c4', 'c01778f4-601e-464b-8e6b-3aef1ac24141', 'd15c87e6-3337-41c7-af2b-4d834aedd37e'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:41 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['a360f729-4031-4494-b1d2-76e95ff0752d', '02c01cd1-f193-40c9-a7a4-9eda57b5a7c6', 'c0656814-0b77-4f3c-b747-0c2a26d29cb2', '5d0ff6c2-6c30-4d65-9b97-076f5a9099c7'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.081s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:41 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:36:41 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ee34a74f-026a-4e2b-93d6-c3714af58927 tempest-GroupSnapshotsTest-1890139390 None] Delete group completed successfully.
Sep 17 15:36:42 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d3b9a5cc-6992-42d5-860f-eb54a0494e58 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d3b9a5cc-6992-42d5-860f-eb54a0494e58 tempest-GroupSnapshotsTest-1890139390 None] Group tempest-GroupSnapshotsTest-Group-1733896626: creating
Sep 17 15:36:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d3b9a5cc-6992-42d5-860f-eb54a0494e58 tempest-GroupSnapshotsTest-1890139390 None] Group tempest-GroupSnapshotsTest-Group-1733896626: created successfully
Sep 17 15:36:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d3b9a5cc-6992-42d5-860f-eb54a0494e58 tempest-GroupSnapshotsTest-1890139390 None] Create group completed successfully.
Sep 17 15:36:43 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Flow 'volume_create_manager' (aa797953-445e-4184-bba3-fb4c6f2ceb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae62478b-d3b3-4b96-b45d-a1a4cc8824a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae62478b-d3b3-4b96-b45d-a1a4cc8824a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1053711835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=651002c1-f19e-45d2-99fd-6d80a89a26b8,host='devstack@QuobyteHD#QuobyteHD',id=abc55747-5cb5-4bdb-84b4-cf1719f0c803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3774d49b1ac45528b81cba69bf29115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:36:43Z,use_quota=True,user_id='60f703f7e3bf40a68ec265e85efec7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a41056-bad5-4262-8389-e3b3259db519),volume_type_id=a2a41056-bad5-4262-8389-e3b3259db519)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2180c1a6-0439-491f-b0b7-f19d66c6e034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2180c1a6-0439-491f-b0b7-f19d66c6e034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9edee3d-5c3b-4334-aa4d-85376978fa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9edee3d-5c3b-4334-aa4d-85376978fa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc55747-5cb5-4bdb-84b4-cf1719f0c803', 'volume_name': 'volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3d9ef6-a8af-4dfd-902d-d89518080bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3d9ef6-a8af-4dfd-902d-d89518080bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44896931-0bce-41df-aa98-75db619eb43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:43 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Volume abc55747-5cb5-4bdb-84b4-cf1719f0c803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803', 'volume_size': 1}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=651002c1-f19e-45d2-99fd-6d80a89a26b8,created_at=2025-09-17T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1053711835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=651002c1-f19e-45d2-99fd-6d80a89a26b8,host='devstack@QuobyteHD#QuobyteHD',id=abc55747-5cb5-4bdb-84b4-cf1719f0c803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3774d49b1ac45528b81cba69bf29115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:36:43Z,use_quota=True,user_id='60f703f7e3bf40a68ec265e85efec7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a41056-bad5-4262-8389-e3b3259db519),volume_type_id=a2a41056-bad5-4262-8389-e3b3259db519)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Creating volume abc55747-5cb5-4bdb-84b4-cf1719f0c803 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:36:43 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:43 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=113, name=volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 1073741824" returned: 0 in 0.294s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] <== create_volume: return (442ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.455s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=99,cinder:SELECT=93,cinder:INSERT=16,cinder:DELETE=5 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44896931-0bce-41df-aa98-75db619eb43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e64d29-6665-4f9c-a517-7a06e6f22d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=105,cinder:INSERT=27,cinder:UPDATE=106,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:36:44 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Volume volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 (abc55747-5cb5-4bdb-84b4-cf1719f0c803): created successfully
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e64d29-6665-4f9c-a517-7a06e6f22d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Flow 'volume_create_manager' (aa797953-445e-4184-bba3-fb4c6f2ceb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:36:44 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-99c6638f-fee8-4fb5-82e5-c88e278b3786 tempest-GroupSnapshotsTest-1890139390 None] Created volume successfully.
Sep 17 15:36:44 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] GroupSnapshot 594303aa-22fb-4872-8d1b-53dd55cf9715: creating.
Sep 17 15:36:44 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Group snapshot 594303aa-22fb-4872-8d1b-53dd55cf9715: creating. {{(pid=83214) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Creating offline snapshot be6054d0-af27-4671-80d2-f8a4613471d4 of volume abc55747-5cb5-4bdb-84b4-cf1719f0c803 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[64450075-892a-4db7-b386-2915678649a1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803" returned: 0 in 0.419s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:45 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=114, name=volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 1G" returned: 0 in 0.205s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img rebase -u -b volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img rebase -u -b volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4" returned: 0 in 0.122s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4" returned: 0 in 0.098s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4" returned: 0 in 0.085s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.info" returned: 0 in 0.107s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:36:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.info" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.413s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d931b8de-f496-45f9-ac9e-aa5a44a5aeeb tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 594303aa-22fb-4872-8d1b-53dd55cf9715: created successfully
Sep 17 15:36:47 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 594303aa-22fb-4872-8d1b-53dd55cf9715: deleting
Sep 17 15:36:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 594303aa-22fb-4872-8d1b-53dd55cf9715: deleting {{(pid=83214) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-abc55747-5cb5-4bdb-84b4-cf1719f0c803" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-abc55747-5cb5-4bdb-84b4-cf1719f0c803" acquired by "delete_snapshot" :: waited 0.053s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-be6054d0-af27-4671-80d2-f8a4613471d4" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-be6054d0-af27-4671-80d2-f8a4613471d4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Deleting offline snapshot be6054d0-af27-4671-80d2-f8a4613471d4 of volume abc55747-5cb5-4bdb-84b4-cf1719f0c803 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] snapshot_file for this snap is: volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[75daa1b2-8eba-43bc-ad6f-b9d67e058e34]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4" returned: 0 in 0.354s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9212313-f345-4836-ac57-e98613449ab6]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803" returned: 0 in 0.372s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:48 devstack quobyte-client[83236]: System call of process 96662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:36:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4" returned: 0 in 0.208s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803.be6054d0-af27-4671-80d2-f8a4613471d4" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-be6054d0-af27-4671-80d2-f8a4613471d4" released by "_delete_snapshot" :: held 1.303s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-abc55747-5cb5-4bdb-84b4-cf1719f0c803" released by "delete_snapshot" :: held 1.324s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:48 devstack cinder-volume[83214]: WARNING cinder.quota [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2102345695 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2102345695, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:36:48 devstack cinder-volume[83214]: WARNING cinder.quota [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2102345695 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2102345695, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:36:48 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['ed3bdf9b-587f-4c15-b88f-0198bde0c7d4', '2991b306-1381-4a41-8ad6-c81c788e7fe3', '56333f2d-52c2-4de0-89a4-2837b89d5c96', 'f76a0f5d-32d4-4080-9274-a1edc11dc882'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:48 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-89d99394-69d2-4a9c-a72b-4d55a863930e tempest-GroupSnapshotsTest-1890139390 None] group_snapshot 594303aa-22fb-4872-8d1b-53dd55cf9715: deleted successfully
Sep 17 15:36:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:36:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "cinder-quobyte-abc55747-5cb5-4bdb-84b4-cf1719f0c803" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:36:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-abc55747-5cb5-4bdb-84b4-cf1719f0c803" acquired by "delete_volume" :: waited 0.015s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:36:49 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc267d-782c-47e8-b7f7-d7a49c851959]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:36:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803" returned: 0 in 0.385s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-abc55747-5cb5-4bdb-84b4-cf1719f0c803" returned: 0 in 0.112s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Lock "cinder-quobyte-abc55747-5cb5-4bdb-84b4-cf1719f0c803" released by "delete_volume" :: held 0.654s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['ae3fcee4-f818-4895-9708-98f9a5ec2587'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:50 devstack cinder-volume[83214]: WARNING cinder.quota [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2102345695 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2102345695, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Created reservations ['2c590112-0e36-4bcf-849e-2fe20f5e9dcf', '03688f31-2655-4809-8158-9f238a578cd3', '6492460c-3814-4d2c-9bd0-3e9096d24611', '0a636901-5673-4809-9e65-f0122147a307'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:36:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:36:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.144s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:36:51 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:36:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a9784084-85c1-42f3-84e3-fc1d6d2c7ca8 tempest-GroupSnapshotsTest-1890139390 None] Delete group completed successfully.
Sep 17 15:37:00 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=24,cinder:DELETE=1,cinder:SELECT=20,cinder:INSERT=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:37:00 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=22,cinder:UPDATE=14,cinder:INSERT=5 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:37:01 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d8b9e8e9-8b2e-4773-9da1-34fae0cd0340 tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d8b9e8e9-8b2e-4773-9da1-34fae0cd0340 tempest-GroupsTest-593351040 None] Group tempest-Group1-1880533407: creating
Sep 17 15:37:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d8b9e8e9-8b2e-4773-9da1-34fae0cd0340 tempest-GroupsTest-593351040 None] Group tempest-Group1-1880533407: created successfully
Sep 17 15:37:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d8b9e8e9-8b2e-4773-9da1-34fae0cd0340 tempest-GroupsTest-593351040 None] Create group completed successfully.
Sep 17 15:37:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-6457b625-aa3e-4e36-bee4-ca63979d1949 tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-6457b625-aa3e-4e36-bee4-ca63979d1949 tempest-GroupsTest-593351040 None] Group tempest-Group2-769635455: creating
Sep 17 15:37:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-6457b625-aa3e-4e36-bee4-ca63979d1949 tempest-GroupsTest-593351040 None] Group tempest-Group2-769635455: created successfully
Sep 17 15:37:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-6457b625-aa3e-4e36-bee4-ca63979d1949 tempest-GroupsTest-593351040 None] Create group completed successfully.
Sep 17 15:37:03 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Flow 'volume_create_manager' (c8f807f9-4ca6-4fae-86ea-7749c19b0b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0511763b-18ce-4838-910b-fcc410e71645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0511763b-18ce-4838-910b-fcc410e71645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-433991232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=166b5960-e6d6-4ad3-84fb-d3e83da677de,host='devstack@QuobyteHD#QuobyteHD',id=6538ec73-d2e2-4629-9ed6-30852e994f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133621c93d4845798805b1cb895c1313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:37:04Z,use_quota=True,user_id='ea111d287b894186a8fa9f3596dfb4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cc0b799-b782-44eb-bebc-66d5b3efc89d),volume_type_id=7cc0b799-b782-44eb-bebc-66d5b3efc89d)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d454aa48-2c4d-4c07-924f-e054498e9d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d454aa48-2c4d-4c07-924f-e054498e9d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bd5395-a57b-42b3-96ea-0cd16e0fd661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bd5395-a57b-42b3-96ea-0cd16e0fd661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6538ec73-d2e2-4629-9ed6-30852e994f2d', 'volume_name': 'volume-6538ec73-d2e2-4629-9ed6-30852e994f2d', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f1d1f2-6d82-4287-ad71-0e9b844bc4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f1d1f2-6d82-4287-ad71-0e9b844bc4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea719ab-6b46-413c-8118-f5094ad48cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:03 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Volume 6538ec73-d2e2-4629-9ed6-30852e994f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6538ec73-d2e2-4629-9ed6-30852e994f2d', 'volume_size': 1}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=166b5960-e6d6-4ad3-84fb-d3e83da677de,created_at=2025-09-17T13:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-433991232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=166b5960-e6d6-4ad3-84fb-d3e83da677de,host='devstack@QuobyteHD#QuobyteHD',id=6538ec73-d2e2-4629-9ed6-30852e994f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133621c93d4845798805b1cb895c1313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:37:04Z,use_quota=True,user_id='ea111d287b894186a8fa9f3596dfb4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cc0b799-b782-44eb-bebc-66d5b3efc89d),volume_type_id=7cc0b799-b782-44eb-bebc-66d5b3efc89d)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Creating volume 6538ec73-d2e2-4629-9ed6-30852e994f2d {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:37:03 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:37:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6538ec73-d2e2-4629-9ed6-30852e994f2d 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:03 devstack quobyte-client[83236]: System call of process 96682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:37:03 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=116, name=volume-6538ec73-d2e2-4629-9ed6-30852e994f2d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:37:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6538ec73-d2e2-4629-9ed6-30852e994f2d 1073741824" returned: 0 in 0.305s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6538ec73-d2e2-4629-9ed6-30852e994f2d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6538ec73-d2e2-4629-9ed6-30852e994f2d" returned: 0 in 0.102s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] <== create_volume: return (473ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:37:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.486s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea719ab-6b46-413c-8118-f5094ad48cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6538ec73-d2e2-4629-9ed6-30852e994f2d', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196f39ce-8fa3-4b5e-8e5b-a48654f1df81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:04 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Volume volume-6538ec73-d2e2-4629-9ed6-30852e994f2d (6538ec73-d2e2-4629-9ed6-30852e994f2d): created successfully
Sep 17 15:37:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196f39ce-8fa3-4b5e-8e5b-a48654f1df81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:04 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Flow 'volume_create_manager' (c8f807f9-4ca6-4fae-86ea-7749c19b0b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:37:04 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-baa9bede-220d-4d54-ac20-f9c6cc100457 tempest-GroupsTest-593351040 None] Created volume successfully.
Sep 17 15:37:05 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Acquiring lock "cinder-quobyte-6538ec73-d2e2-4629-9ed6-30852e994f2d" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Lock "cinder-quobyte-6538ec73-d2e2-4629-9ed6-30852e994f2d" acquired by "delete_volume" :: waited 0.041s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:05 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20fa2e6-91a6-4735-8857-53fea2e750b6]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6538ec73-d2e2-4629-9ed6-30852e994f2d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6538ec73-d2e2-4629-9ed6-30852e994f2d" returned: 0 in 0.397s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6538ec73-d2e2-4629-9ed6-30852e994f2d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6538ec73-d2e2-4629-9ed6-30852e994f2d" returned: 0 in 0.108s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Lock "cinder-quobyte-6538ec73-d2e2-4629-9ed6-30852e994f2d" released by "delete_volume" :: held 0.643s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Created reservations ['88631d57-6b05-43d8-883f-1bab345285a3'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:06 devstack cinder-volume[83214]: WARNING cinder.quota [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1555119488 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1555119488, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:37:06 devstack cinder-volume[83214]: WARNING cinder.quota [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1555119488 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1555119488, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Created reservations ['bae37126-b001-42bb-a263-d262aff958c5', 'd28ac313-72ef-4c47-a17b-2c63e771ce0c', '07660c91-6d46-451d-99c3-ce57982e2c80', '95513fcd-5ac7-4774-b119-1465c0055e31'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.094s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:06 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:37:06 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-98a14d0c-6a95-485f-b2cd-61cbec5dfbec tempest-GroupsTest-593351040 None] Delete group completed successfully.
Sep 17 15:37:07 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:07 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Created reservations ['fd448a10-3cbe-492c-b25f-b13334ca6459'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:37:07 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:37:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.088s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:07 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:37:08 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c4dc24c9-637f-4496-98e5-b2e16a88e563 tempest-GroupsTest-593351040 None] Delete group completed successfully.
Sep 17 15:37:09 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c4616fae-da97-46f8-a2b2-f108b95580e5 tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:09 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c4616fae-da97-46f8-a2b2-f108b95580e5 tempest-GroupsTest-593351040 None] Group tempest-GroupsTest-Group-715402180: creating
Sep 17 15:37:09 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c4616fae-da97-46f8-a2b2-f108b95580e5 tempest-GroupsTest-593351040 None] Group tempest-GroupsTest-Group-715402180: created successfully
Sep 17 15:37:09 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c4616fae-da97-46f8-a2b2-f108b95580e5 tempest-GroupsTest-593351040 None] Create group completed successfully.
Sep 17 15:37:10 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Flow 'volume_create_manager' (05c3111a-9589-4fbc-9f8c-680ef6503d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4645b4da-e065-421b-9e68-bf1cb3ff2eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4645b4da-e065-421b-9e68-bf1cb3ff2eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960581414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7fc964a-120a-477c-9818-27a3ceb0310e,host='devstack@QuobyteHD#QuobyteHD',id=2631d19a-c299-4d70-a80b-2715bc4e01a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133621c93d4845798805b1cb895c1313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:37:11Z,use_quota=True,user_id='ea111d287b894186a8fa9f3596dfb4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(742d1e04-3145-4f96-9f9c-077f90bfe0e2),volume_type_id=742d1e04-3145-4f96-9f9c-077f90bfe0e2)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68068ea-e6f7-4cbf-934a-bc0e676b77b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68068ea-e6f7-4cbf-934a-bc0e676b77b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f5ab72-6dde-4428-87d6-2f7fd346b503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f5ab72-6dde-4428-87d6-2f7fd346b503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2631d19a-c299-4d70-a80b-2715bc4e01a6', 'volume_name': 'volume-2631d19a-c299-4d70-a80b-2715bc4e01a6', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d8f529-0cbe-41e3-a6e2-d0e66e57541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d8f529-0cbe-41e3-a6e2-d0e66e57541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4464d443-7355-422e-a82d-54ab0d2abc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:10 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Volume 2631d19a-c299-4d70-a80b-2715bc4e01a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2631d19a-c299-4d70-a80b-2715bc4e01a6', 'volume_size': 1}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a7fc964a-120a-477c-9818-27a3ceb0310e,created_at=2025-09-17T13:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960581414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7fc964a-120a-477c-9818-27a3ceb0310e,host='devstack@QuobyteHD#QuobyteHD',id=2631d19a-c299-4d70-a80b-2715bc4e01a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133621c93d4845798805b1cb895c1313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:37:11Z,use_quota=True,user_id='ea111d287b894186a8fa9f3596dfb4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(742d1e04-3145-4f96-9f9c-077f90bfe0e2),volume_type_id=742d1e04-3145-4f96-9f9c-077f90bfe0e2)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Creating volume 2631d19a-c299-4d70-a80b-2715bc4e01a6 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:37:10 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:37:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2631d19a-c299-4d70-a80b-2715bc4e01a6 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:10 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=117, name=volume-2631d19a-c299-4d70-a80b-2715bc4e01a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:37:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2631d19a-c299-4d70-a80b-2715bc4e01a6 1073741824" returned: 0 in 0.309s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2631d19a-c299-4d70-a80b-2715bc4e01a6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2631d19a-c299-4d70-a80b-2715bc4e01a6" returned: 0 in 0.092s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] <== create_volume: return (472ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:37:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.485s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4464d443-7355-422e-a82d-54ab0d2abc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2631d19a-c299-4d70-a80b-2715bc4e01a6', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd15e52-e4e8-4864-ae95-d09fa714070d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:11 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Volume volume-2631d19a-c299-4d70-a80b-2715bc4e01a6 (2631d19a-c299-4d70-a80b-2715bc4e01a6): created successfully
Sep 17 15:37:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd15e52-e4e8-4864-ae95-d09fa714070d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Flow 'volume_create_manager' (05c3111a-9589-4fbc-9f8c-680ef6503d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:37:11 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c7059807-c1d5-44c4-8bb1-a143406ad01e tempest-GroupsTest-593351040 None] Created volume successfully.
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.274s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:37:12 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Flow 'volume_create_manager' (e148f42d-0043-4b3e-aa6a-2fdf4327b674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499cabfa-52a5-482d-b6ab-136bf2e3e2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499cabfa-52a5-482d-b6ab-136bf2e3e2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1278357740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7fc964a-120a-477c-9818-27a3ceb0310e,host='devstack@QuobyteHD#QuobyteHD',id=7d6ad486-2666-42ee-a6a5-75357745a2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133621c93d4845798805b1cb895c1313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:37:12Z,use_quota=True,user_id='ea111d287b894186a8fa9f3596dfb4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(742d1e04-3145-4f96-9f9c-077f90bfe0e2),volume_type_id=742d1e04-3145-4f96-9f9c-077f90bfe0e2)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407038a8-caf7-490d-9cd1-2ef7e52f5945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407038a8-caf7-490d-9cd1-2ef7e52f5945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e0d28c-8219-49f3-adef-0282a9089599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e0d28c-8219-49f3-adef-0282a9089599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d6ad486-2666-42ee-a6a5-75357745a2cf', 'volume_name': 'volume-7d6ad486-2666-42ee-a6a5-75357745a2cf', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3512ab-6adb-4a01-a9ab-3aa8310e9ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3512ab-6adb-4a01-a9ab-3aa8310e9ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127dcf94-1ab5-41ae-a272-472bc0ef97b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:12 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Volume 7d6ad486-2666-42ee-a6a5-75357745a2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d6ad486-2666-42ee-a6a5-75357745a2cf', 'volume_size': 1}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a7fc964a-120a-477c-9818-27a3ceb0310e,created_at=2025-09-17T13:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1278357740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7fc964a-120a-477c-9818-27a3ceb0310e,host='devstack@QuobyteHD#QuobyteHD',id=7d6ad486-2666-42ee-a6a5-75357745a2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133621c93d4845798805b1cb895c1313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:37:12Z,use_quota=True,user_id='ea111d287b894186a8fa9f3596dfb4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(742d1e04-3145-4f96-9f9c-077f90bfe0e2),volume_type_id=742d1e04-3145-4f96-9f9c-077f90bfe0e2)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Creating volume 7d6ad486-2666-42ee-a6a5-75357745a2cf {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:37:12 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:37:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7d6ad486-2666-42ee-a6a5-75357745a2cf 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:12 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=118, name=volume-7d6ad486-2666-42ee-a6a5-75357745a2cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:37:12 devstack quobyte-client[83236]: System call of process 96698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:37:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7d6ad486-2666-42ee-a6a5-75357745a2cf 1073741824" returned: 0 in 0.286s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7d6ad486-2666-42ee-a6a5-75357745a2cf {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7d6ad486-2666-42ee-a6a5-75357745a2cf" returned: 0 in 0.105s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:13 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] <== create_volume: return (446ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:37:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.458s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127dcf94-1ab5-41ae-a272-472bc0ef97b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d6ad486-2666-42ee-a6a5-75357745a2cf', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12ab36-bc8c-4cd6-aab4-41b247e6ea65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:13 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Volume volume-7d6ad486-2666-42ee-a6a5-75357745a2cf (7d6ad486-2666-42ee-a6a5-75357745a2cf): created successfully
Sep 17 15:37:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12ab36-bc8c-4cd6-aab4-41b247e6ea65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:13 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Flow 'volume_create_manager' (e148f42d-0043-4b3e-aa6a-2fdf4327b674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:37:13 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-52b1f359-6bd1-4d5c-bffe-b0beab168f3e tempest-GroupsTest-593351040 None] Created volume successfully.
Sep 17 15:37:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-927c43de-9056-4502-94cb-67fa7b53ae73 tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:14 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-927c43de-9056-4502-94cb-67fa7b53ae73 tempest-GroupsTest-593351040 None] Update group completed successfully.
Sep 17 15:37:15 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-89a44f5e-3bf5-436c-92b3-cc7b7d4447b9 tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:15 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-89a44f5e-3bf5-436c-92b3-cc7b7d4447b9 tempest-GroupsTest-593351040 None] Update group completed successfully.
Sep 17 15:37:17 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Acquiring lock "cinder-quobyte-2631d19a-c299-4d70-a80b-2715bc4e01a6" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Lock "cinder-quobyte-2631d19a-c299-4d70-a80b-2715bc4e01a6" acquired by "delete_volume" :: waited 0.025s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d648ed-853c-4636-a759-ea9ed6e8268d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2631d19a-c299-4d70-a80b-2715bc4e01a6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2631d19a-c299-4d70-a80b-2715bc4e01a6" returned: 0 in 0.398s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2631d19a-c299-4d70-a80b-2715bc4e01a6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-2631d19a-c299-4d70-a80b-2715bc4e01a6" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Lock "cinder-quobyte-2631d19a-c299-4d70-a80b-2715bc4e01a6" released by "delete_volume" :: held 0.652s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Acquiring lock "cinder-quobyte-7d6ad486-2666-42ee-a6a5-75357745a2cf" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Lock "cinder-quobyte-7d6ad486-2666-42ee-a6a5-75357745a2cf" acquired by "delete_volume" :: waited 0.023s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3167dbdc-a6f8-410c-b9da-ccf35a780167]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7d6ad486-2666-42ee-a6a5-75357745a2cf {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7d6ad486-2666-42ee-a6a5-75357745a2cf" returned: 0 in 0.377s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7d6ad486-2666-42ee-a6a5-75357745a2cf {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7d6ad486-2666-42ee-a6a5-75357745a2cf" returned: 0 in 0.106s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Lock "cinder-quobyte-7d6ad486-2666-42ee-a6a5-75357745a2cf" released by "delete_volume" :: held 0.627s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:18 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Created reservations ['31efdcb7-83cd-40cb-a2ad-7b23a1dd24cd'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:18 devstack cinder-volume[83214]: WARNING cinder.quota [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-146743587 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-146743587, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:37:18 devstack cinder-volume[83214]: WARNING cinder.quota [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-146743587 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-146743587, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:37:18 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Created reservations ['95f20c45-bfb5-47e8-8e1e-89cef5786cb1', '47787599-e152-40f2-88c0-e9cf35ff62b8', 'e2e99fc8-c630-47db-858b-33167c94f2e8', '76b42935-42e4-4cc9-b611-b7be8959fff8'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:19 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Created reservations ['141f7e39-ed20-47b4-9fb6-b055cdc108a8', 'f7708332-9914-4520-b107-b8446f0f951e', '47bb4c1c-646f-406d-a18e-a07b370b2ef3', 'ca0248c0-d692-457d-90ce-c616d6114472'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:37:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:37:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:19 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:37:19 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-98298b4b-4576-4b68-8b1f-2f320e55de50 tempest-GroupsTest-593351040 None] Delete group completed successfully.
Sep 17 15:37:29 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=40,cinder:UPDATE=47,cinder:DELETE=3,cinder:INSERT=9 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:37:29 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=38,cinder:SELECT=40,cinder:INSERT=6 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:37:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Flow 'volume_create_manager' (9e8301b4-ce66-458e-b3bf-151da8e846ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0e6e4f-11c6-4661-83fe-599676c34ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0e6e4f-11c6-4661-83fe-599676c34ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1711937685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=686edeb8-b077-4917-818a-8e15d51e2b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0119d78dd5f24ca7b0e45b0f79f23d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:37:30Z,use_quota=True,user_id='0f1e75d392404877af5f86f6c0891c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387ec11a-431a-4178-8b9b-003eb6615258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387ec11a-431a-4178-8b9b-003eb6615258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554436ce-558e-4985-a45b-707878677ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554436ce-558e-4985-a45b-707878677ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '686edeb8-b077-4917-818a-8e15d51e2b04', 'volume_name': 'volume-686edeb8-b077-4917-818a-8e15d51e2b04', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e30efe-10ec-4494-88c5-53654f7a46ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e30efe-10ec-4494-88c5-53654f7a46ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa129d50-be0c-420e-ab4d-14485019fd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:30 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Volume 686edeb8-b077-4917-818a-8e15d51e2b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-686edeb8-b077-4917-818a-8e15d51e2b04', 'volume_size': 1}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1711937685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=686edeb8-b077-4917-818a-8e15d51e2b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0119d78dd5f24ca7b0e45b0f79f23d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:37:30Z,use_quota=True,user_id='0f1e75d392404877af5f86f6c0891c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Creating volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:37:30 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:30 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=119, name=volume-686edeb8-b077-4917-818a-8e15d51e2b04, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 1073741824" returned: 0 in 0.296s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] <== create_volume: return (439ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.452s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa129d50-be0c-420e-ab4d-14485019fd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-686edeb8-b077-4917-818a-8e15d51e2b04', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb82ef4-fc4d-467b-8c07-e895dc0e45a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:37:31 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Volume volume-686edeb8-b077-4917-818a-8e15d51e2b04 (686edeb8-b077-4917-818a-8e15d51e2b04): created successfully
Sep 17 15:37:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb82ef4-fc4d-467b-8c07-e895dc0e45a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:37:31 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Flow 'volume_create_manager' (9e8301b4-ce66-458e-b3bf-151da8e846ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:37:31 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b64bbef8-ee45-47dc-aee0-b180aea55db8 tempest-SnapshotsActionsTest-1353021033 None] Created volume successfully.
Sep 17 15:37:32 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Creating offline snapshot ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:37:32 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d1823b-d5bb-4003-a655-7103b60f3d2e]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04" returned: 0 in 0.369s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:32 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=120, name=volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea 1G" returned: 0 in 0.227s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:33 devstack quobyte-client[83236]: System call of process 96755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.127s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.087s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.084s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.info" returned: 0 in 0.085s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.info" returned: 0 in 0.079s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.378s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2fb86332-632d-4d1b-88a6-01158bafcf23 tempest-SnapshotsActionsTest-1353021033 None] Create snapshot completed successfully
Sep 17 15:37:34 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Creating offline snapshot 42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:37:34 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a58de97-1feb-4426-826d-60e814477bba]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.375s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:35 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=122, name=volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 1G" returned: 0 in 0.227s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9" returned: 0 in 0.123s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9" returned: 0 in 0.092s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:37:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9" returned: 0 in 0.112s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.181s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:36 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b4bcfa78-2044-4b62-a169-89d54f6e346a tempest-SnapshotsActionsTest-1353021033 None] Create snapshot completed successfully
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:37 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-quobyte-42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Deleting offline snapshot 42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] snapshot_file for this snap is: volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e41309-ade3-41b7-b275-a8fd1325b11b]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9" returned: 0 in 0.364s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1c6b25-613d-4106-9be9-fa29826826c7]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.374s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9" returned: 0 in 0.236s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9" returned: 0 in 0.080s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9" released by "_delete_snapshot" :: held 1.316s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" released by "delete_snapshot" :: held 1.342s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Created reservations ['91b8b97a-fabe-40c5-a16d-1e0508300ee1', 'aeafbbfa-365d-4518-bfc0-205f0f16bcbc', '526372f5-c563-421e-bede-dd073d105f58', 'b50a7ea1-d0ee-490f-a47e-705597a322e5'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:38 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Delete snapshot completed successfully.
Sep 17 15:37:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-30312a98-ab96-495b-b23d-2bf753ce93ed tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-42a16f7f-1d26-4b4a-adc5-cdbbc4036cc9-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Creating offline snapshot bddcec59-6726-4e72-9e97-cfed594851b6 of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:37:39 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc85879-39fa-4cc4-b225-8c82cd147e8d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.366s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:40 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=123, name=volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 1G" returned: 0 in 0.220s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6" returned: 0 in 0.118s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6" returned: 0 in 0.077s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6" returned: 0 in 0.093s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.119s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:40 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a3b39df5-85fa-499d-b8a6-c2fc9bec4968 tempest-SnapshotsActionsTest-1353021033 None] Create snapshot completed successfully
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-bddcec59-6726-4e72-9e97-cfed594851b6-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-bddcec59-6726-4e72-9e97-cfed594851b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:41 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-quobyte-bddcec59-6726-4e72-9e97-cfed594851b6" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-bddcec59-6726-4e72-9e97-cfed594851b6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Deleting offline snapshot bddcec59-6726-4e72-9e97-cfed594851b6 of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] snapshot_file for this snap is: volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[158ba706-3a1a-4b7c-a0d3-f75749fb4f51]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6" returned: 0 in 0.368s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:42 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:42 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379ff2c-aeb6-4f0f-aa91-655fc5db2034]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.366s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:42 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6" returned: 0 in 0.180s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.bddcec59-6726-4e72-9e97-cfed594851b6" returned: 0 in 0.096s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-bddcec59-6726-4e72-9e97-cfed594851b6" released by "_delete_snapshot" :: held 1.276s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" released by "delete_snapshot" :: held 1.300s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:43 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Created reservations ['5c4634d8-c3a4-4684-8cb7-5e7e57215360', '8e442676-ae4e-4d89-8e8a-6a7978ac1460', '676c957c-f10b-4617-a089-9fd820c2696e', '44cb0cb9-831a-4e42-b91a-1097899d75a4'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:43 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Delete snapshot completed successfully.
Sep 17 15:37:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f5d34a42-29a7-4b25-ba07-ae617dbe445d tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-bddcec59-6726-4e72-9e97-cfed594851b6-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:44 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Creating offline snapshot c3490acb-b968-40fe-ad37-0dde260a8f29 of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c839a96-5810-46be-897f-3fdffda9b0df]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.371s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:44 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=124, name=volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 1G" returned: 0 in 0.210s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29" returned: 0 in 0.173s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:37:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29" returned: 0 in 0.086s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:37:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29" returned: 0 in 0.080s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.219s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:45 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c3cb4972-78a9-4ac1-a015-fa7c22b8206d tempest-SnapshotsActionsTest-1353021033 None] Create snapshot completed successfully
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-c3490acb-b968-40fe-ad37-0dde260a8f29-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-c3490acb-b968-40fe-ad37-0dde260a8f29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-quobyte-c3490acb-b968-40fe-ad37-0dde260a8f29" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-c3490acb-b968-40fe-ad37-0dde260a8f29" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Deleting offline snapshot c3490acb-b968-40fe-ad37-0dde260a8f29 of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] snapshot_file for this snap is: volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[78581dbd-1d1c-4c5b-9b46-55a530fd72db]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29" returned: 0 in 0.380s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ffda09-2768-4b54-9d62-0e8d6a23bc1f]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.366s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:47 devstack quobyte-client[83236]: System call of process 96823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:37:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29" returned: 0 in 0.193s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.c3490acb-b968-40fe-ad37-0dde260a8f29" returned: 0 in 0.100s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-c3490acb-b968-40fe-ad37-0dde260a8f29" released by "_delete_snapshot" :: held 1.289s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" released by "delete_snapshot" :: held 1.309s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:48 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Created reservations ['03ae40e6-c2b1-4b6f-a27a-3bbcf710074f', '99889cb1-4db1-419f-811b-3b2d3cb56e5a', 'dd8be610-8a5c-4bbc-8768-038ae6c217c5', 'cbd66249-6f86-48bd-8cb7-0de1f418735b'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:48 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Delete snapshot completed successfully.
Sep 17 15:37:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4921c9b6-b16f-4b9b-8c17-8b8a205f7f5a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-c3490acb-b968-40fe-ad37-0dde260a8f29-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:48 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Creating offline snapshot a731ca22-ac88-4da8-ab9e-acc917bafdd4 of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:37:48 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c06b2b8-16af-4b11-82da-f4dde160f267]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.360s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:49 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=125, name=volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 1G" returned: 0 in 0.209s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img rebase -u -b volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4" returned: 0 in 0.119s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.100s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:50 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-5c8fdd12-0070-497c-8fd1-02427eca9863 tempest-SnapshotsActionsTest-1353021033 None] Create snapshot completed successfully
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-a731ca22-ac88-4da8-ab9e-acc917bafdd4-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-a731ca22-ac88-4da8-ab9e-acc917bafdd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:51 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Acquiring lock "cinder-quobyte-a731ca22-ac88-4da8-ab9e-acc917bafdd4" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-a731ca22-ac88-4da8-ab9e-acc917bafdd4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Deleting offline snapshot a731ca22-ac88-4da8-ab9e-acc917bafdd4 of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] snapshot_file for this snap is: volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[27140c6a-7036-4716-b774-64499395be95]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4" returned: 0 in 0.456s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce21bc8-f583-4461-978c-8b1a8508468d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.518s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4" returned: 0 in 0.192s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.a731ca22-ac88-4da8-ab9e-acc917bafdd4" returned: 0 in 0.096s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-a731ca22-ac88-4da8-ab9e-acc917bafdd4" released by "_delete_snapshot" :: held 1.570s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" released by "delete_snapshot" :: held 1.597s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Created reservations ['1a689cc1-f656-4d39-9eaf-09c67d551bc3', 'b0a860cd-d915-4a06-ab77-2f54802f97a7', 'dc6deccd-8eca-4e42-aa75-ad25701f1f44', '8e82400b-937c-41c2-ab48-9fc162c155af'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:53 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Delete snapshot completed successfully.
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d8b29192-b430-4d6c-8e6d-367176de857a tempest-SnapshotsActionsTest-2072316399 None] Lock "cinder-a731ca22-ac88-4da8-ab9e-acc917bafdd4-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "cinder-ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "cinder-quobyte-ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-quobyte-ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Deleting offline snapshot ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea of volume 686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] snapshot_file for this snap is: volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e14699-aafb-4b89-86d8-c73e193983c0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.399s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-686edeb8-b077-4917-818a-8e15d51e2b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:37:54 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d698d0c5-e621-4111-95fd-9704481c5302]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04" returned: 0 in 0.397s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.169s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04.ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" returned: 0 in 0.107s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-quobyte-ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea" released by "_delete_snapshot" :: held 1.325s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" released by "delete_snapshot" :: held 1.346s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:55 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Created reservations ['1f5f7f11-6776-4054-957d-0e7639f34f36', '1814d06b-f748-4074-b238-51cafaf0f81c', 'd35d5a9c-7aa4-4d4d-afe5-af2558fa3143', 'b6e63368-838a-4e9d-b6b2-c60dcb035021'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:55 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Delete snapshot completed successfully.
Sep 17 15:37:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4284fcc5-f625-48db-ae5b-fac602c3aa54 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-ef771a71-af7e-4ca4-9ac8-17e6adb4b2ea-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "cinder-686edeb8-b077-4917-818a-8e15d51e2b04-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-686edeb8-b077-4917-818a-8e15d51e2b04-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:56 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:37:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:37:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" acquired by "delete_volume" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:37:56 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb43d93-d234-4fbe-bab6-dafda857786d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:37:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04" returned: 0 in 0.396s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-686edeb8-b077-4917-818a-8e15d51e2b04" returned: 0 in 0.121s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-quobyte-686edeb8-b077-4917-818a-8e15d51e2b04" released by "delete_volume" :: held 0.672s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Created reservations ['f62bcc56-db51-445a-b29f-f964333841aa', '90a160e0-e1e4-49eb-bb32-5d40021ebbe1', 'f1f54a98-715d-45ac-a897-4bd54208a929', '585fd2c6-a697-41ec-985f-90158a74c57c'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.112s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:37:57 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Deleted volume successfully.
Sep 17 15:37:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f753d2fc-e5a2-47ab-aa41-8c74f6e72680 tempest-SnapshotsActionsTest-1353021033 None] Lock "cinder-686edeb8-b077-4917-818a-8e15d51e2b04-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:07 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=34,cinder:UPDATE=39,cinder:DELETE=4,cinder:INSERT=12 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:38:11 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Flow 'volume_create_manager' (4e4a7217-3872-4a1c-8b48-c21a94b6ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd59de9-287a-457b-8c19-f4c7f1168513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd59de9-287a-457b-8c19-f4c7f1168513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1369550862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48ae5d2-846b-4d59-93a6-185b6335d1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2358a3aa34d64d38955d056631de5d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:38:12Z,use_quota=True,user_id='e9417b1c89e945c68ad46ed29ab410f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0746229a-b4a6-43a0-925d-fddc94dd5b56),volume_type_id=0746229a-b4a6-43a0-925d-fddc94dd5b56)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077e88cd-2f3c-411c-ad54-15c9ac081313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077e88cd-2f3c-411c-ad54-15c9ac081313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18734e4-916b-4157-91f8-f9e86d05f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18734e4-916b-4157-91f8-f9e86d05f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48ae5d2-846b-4d59-93a6-185b6335d1b3', 'volume_name': 'volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0254b14a-4a4a-4013-b144-12f8b15a94a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0254b14a-4a4a-4013-b144-12f8b15a94a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecb4c7f-ed43-4306-8be3-6215c5e5d152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:11 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Volume a48ae5d2-846b-4d59-93a6-185b6335d1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3', 'volume_size': 1}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1369550862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48ae5d2-846b-4d59-93a6-185b6335d1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2358a3aa34d64d38955d056631de5d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:38:12Z,use_quota=True,user_id='e9417b1c89e945c68ad46ed29ab410f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0746229a-b4a6-43a0-925d-fddc94dd5b56),volume_type_id=0746229a-b4a6-43a0-925d-fddc94dd5b56)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Creating volume a48ae5d2-846b-4d59-93a6-185b6335d1b3 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:38:11 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:38:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:12 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=126, name=volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3 1073741824" returned: 0 in 0.296s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3" returned: 0 in 0.194s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] <== create_volume: return (559ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.571s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.284s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecb4c7f-ed43-4306-8be3-6215c5e5d152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6431c64c-409d-47fd-91e5-431004b25de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:12 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Volume volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3 (a48ae5d2-846b-4d59-93a6-185b6335d1b3): created successfully
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6431c64c-409d-47fd-91e5-431004b25de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Flow 'volume_create_manager' (4e4a7217-3872-4a1c-8b48-c21a94b6ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:38:12 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9f0f5ea8-b152-45da-aff0-90c39ff1682d tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Created volume successfully.
Sep 17 15:38:14 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:14 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:14 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.106s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:14 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:38:14 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-639ebe69-b6cc-4bc7-a629-d464ded5a6d3 tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Retype volume completed successfully.
Sep 17 15:38:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Acquiring lock "cinder-a48ae5d2-846b-4d59-93a6-185b6335d1b3-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:15 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "cinder-a48ae5d2-846b-4d59-93a6-185b6335d1b3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:16 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Acquiring lock "cinder-quobyte-a48ae5d2-846b-4d59-93a6-185b6335d1b3" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "cinder-quobyte-a48ae5d2-846b-4d59-93a6-185b6335d1b3" acquired by "delete_volume" :: waited 0.009s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:16 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6562d0-d13b-4458-a809-ce0abe5f31af]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:38:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3" returned: 0 in 0.397s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a48ae5d2-846b-4d59-93a6-185b6335d1b3" returned: 0 in 0.110s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:16 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "cinder-quobyte-a48ae5d2-846b-4d59-93a6-185b6335d1b3" released by "delete_volume" :: held 0.657s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:16 devstack cinder-volume[83214]: WARNING cinder.quota [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:38:16 devstack cinder-volume[83214]: WARNING cinder.quota [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Created reservations ['3e871cb5-9ace-40d0-9db2-d1e290ef1937', '597d4ff7-f597-47a2-b48a-3ffaef8a2a00', '70d78eac-62d6-4537-ac01-76aedbccf9b5', '6a792e43-c174-456d-816c-fad7a92cdac8'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.114s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:38:17 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Deleted volume successfully.
Sep 17 15:38:17 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-4b98ebc6-5827-45bf-9917-8918e0e8078b tempest-VolumeRetypeWithoutMigrationTest-574370071 None] Lock "cinder-a48ae5d2-846b-4d59-93a6-185b6335d1b3-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:26 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Flow 'volume_create_manager' (3bff25e5-9db7-4e6e-ba95-5d1fd461640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5c3a8a-e424-4b6e-b598-cf91e5be40b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5c3a8a-e424-4b6e-b598-cf91e5be40b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1125298959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc129a7f-d386-4949-9f5f-fa8a982ccb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181ea253916d4d22b26389a8c334d21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:38:26Z,use_quota=True,user_id='73e66474d04b420f9ee5aaf2f0c34a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c8098c-425e-4275-a9e6-f279f081c672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c8098c-425e-4275-a9e6-f279f081c672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ee9975-87d7-4b51-9758-43f5eca31fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ee9975-87d7-4b51-9758-43f5eca31fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc129a7f-d386-4949-9f5f-fa8a982ccb6e', 'volume_name': 'volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3496083-a826-4414-9b99-bccab6de19c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3496083-a826-4414-9b99-bccab6de19c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62e1a2a-e140-439b-b534-078405077f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:26 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Volume bc129a7f-d386-4949-9f5f-fa8a982ccb6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e', 'volume_size': 1}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1125298959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc129a7f-d386-4949-9f5f-fa8a982ccb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181ea253916d4d22b26389a8c334d21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:38:26Z,use_quota=True,user_id='73e66474d04b420f9ee5aaf2f0c34a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Creating volume bc129a7f-d386-4949-9f5f-fa8a982ccb6e {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:38:26 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:38:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:26 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=127, name=volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:38:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e 1073741824" returned: 0 in 0.329s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" returned: 0 in 0.086s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] <== create_volume: return (487ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:38:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.500s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62e1a2a-e140-439b-b534-078405077f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7df50e-abe8-47ec-92b3-963bec122488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:27 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Volume volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e (bc129a7f-d386-4949-9f5f-fa8a982ccb6e): created successfully
Sep 17 15:38:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7df50e-abe8-47ec-92b3-963bec122488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Flow 'volume_create_manager' (3bff25e5-9db7-4e6e-ba95-5d1fd461640f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:38:27 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-cce4eff1-6919-43ee-b1fd-16c0b7e1b3d1 tempest-SnapshotMetadataTestJSON-1034033671 None] Created volume successfully.
Sep 17 15:38:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Creating offline snapshot 9e306d26-2adc-4d74-93e8-88fdc6d63b77 of volume bc129a7f-d386-4949-9f5f-fa8a982ccb6e {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:38:28 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e3e5e7-2377-4f9f-bce3-7e7c5f175306]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:38:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" returned: 0 in 0.412s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:29 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=128, name=volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 1G" returned: 0 in 0.207s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "qemu-img rebase -u -b volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77" returned: 0 in 0.118s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77" returned: 0 in 0.089s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77" returned: 0 in 0.081s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.info" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:38:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.info" returned: 0 in 0.160s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.445s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:30 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=54,cinder:UPDATE=65,cinder:DELETE=4,cinder:INSERT=16 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:38:30 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-94ce7712-9dd1-49df-b16c-f9e0d4c395eb tempest-SnapshotMetadataTestJSON-1034033671 None] Create snapshot completed successfully
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Acquiring lock "cinder-9e306d26-2adc-4d74-93e8-88fdc6d63b77-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-9e306d26-2adc-4d74-93e8-88fdc6d63b77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:31 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Acquiring lock "cinder-quobyte-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-quobyte-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Acquiring lock "cinder-quobyte-9e306d26-2adc-4d74-93e8-88fdc6d63b77" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-quobyte-9e306d26-2adc-4d74-93e8-88fdc6d63b77" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Deleting offline snapshot 9e306d26-2adc-4d74-93e8-88fdc6d63b77 of volume bc129a7f-d386-4949-9f5f-fa8a982ccb6e {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] snapshot_file for this snap is: volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c7b42-1e08-453e-a777-906b96448dd3]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:38:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77" returned: 0 in 0.363s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1041e98-6669-4f38-acb0-bd5fa83d7a84]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" returned: 0 in 0.386s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77" returned: 0 in 0.174s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e.9e306d26-2adc-4d74-93e8-88fdc6d63b77" returned: 0 in 0.102s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-quobyte-9e306d26-2adc-4d74-93e8-88fdc6d63b77" released by "_delete_snapshot" :: held 1.288s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-quobyte-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" released by "delete_snapshot" :: held 1.312s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:33 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Created reservations ['6115730d-08fc-43c7-81ac-4cc6d99cf3dc', '39346384-dd7f-4442-ba0e-77ef387adac3', '6619d879-0d79-474c-b4ff-0960290eb0c8', 'ccfe6b64-77ae-456b-888e-a0e38155b361'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:38:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Delete snapshot completed successfully.
Sep 17 15:38:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1a0d9013-2d64-417f-9135-adcabbf0dce2 tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-9e306d26-2adc-4d74-93e8-88fdc6d63b77-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Acquiring lock "cinder-bc129a7f-d386-4949-9f5f-fa8a982ccb6e-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-bc129a7f-d386-4949-9f5f-fa8a982ccb6e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:33 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Acquiring lock "cinder-quobyte-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-quobyte-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" acquired by "delete_volume" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:33 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ea531b-8f93-4e90-add8-1476fdf5c191]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:38:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" returned: 0 in 0.385s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" returned: 0 in 0.112s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-quobyte-bc129a7f-d386-4949-9f5f-fa8a982ccb6e" released by "delete_volume" :: held 0.637s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Created reservations ['9370ff61-3546-4b16-9b14-56fc8f5fb8ab', '634300ba-6452-4372-b26d-26273d7b625e', 'a95a95cc-4731-4fca-8638-912b0b28c7f4', 'bfdec674-d714-4182-876a-1c87f9192b5a'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.115s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:35 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:38:35 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Deleted volume successfully.
Sep 17 15:38:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-34b65a8d-5f07-401b-b2b1-7842339b34cc tempest-SnapshotMetadataTestJSON-1034033671 None] Lock "cinder-bc129a7f-d386-4949-9f5f-fa8a982ccb6e-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:41 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Flow 'volume_create_manager' (e760cb62-0fb7-4ced-bf80-fe35895de2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8869f3ab-eca5-4409-8e97-cb7f55dfc9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8869f3ab-eca5-4409-8e97-cb7f55dfc9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1193736208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622429c6-aa5b-4363-9831-2912bd2b8c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1668462701d8433ea675970e605e898d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:38:41Z,use_quota=True,user_id='e5bbb38af9174bedb95a6b9d4d48b5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4533d3fc-f352-49de-975b-60a92342653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4533d3fc-f352-49de-975b-60a92342653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0778dc-5c5b-4bf1-98d6-d3c97622f6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0778dc-5c5b-4bf1-98d6-d3c97622f6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622429c6-aa5b-4363-9831-2912bd2b8c52', 'volume_name': 'volume-622429c6-aa5b-4363-9831-2912bd2b8c52', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182c485a-e3fd-4e87-ac39-614dea98ea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182c485a-e3fd-4e87-ac39-614dea98ea09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a02c9f-0eef-4411-b5d5-397e92930f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:41 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Volume 622429c6-aa5b-4363-9831-2912bd2b8c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622429c6-aa5b-4363-9831-2912bd2b8c52', 'volume_size': 1}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1193736208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622429c6-aa5b-4363-9831-2912bd2b8c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1668462701d8433ea675970e605e898d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:38:41Z,use_quota=True,user_id='e5bbb38af9174bedb95a6b9d4d48b5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Creating volume 622429c6-aa5b-4363-9831-2912bd2b8c52 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:38:41 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-622429c6-aa5b-4363-9831-2912bd2b8c52 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:41 devstack quobyte-client[83236]: System call of process 96953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:38:41 devstack quobyte-client[83236]: System call of process 96953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:38:41 devstack quobyte-client[83236]: System call of process 96953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:38:41 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=130, name=volume-622429c6-aa5b-4363-9831-2912bd2b8c52, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-622429c6-aa5b-4363-9831-2912bd2b8c52 1073741824" returned: 0 in 0.306s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-622429c6-aa5b-4363-9831-2912bd2b8c52 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-622429c6-aa5b-4363-9831-2912bd2b8c52" returned: 0 in 0.084s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] <== create_volume: return (454ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.468s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a02c9f-0eef-4411-b5d5-397e92930f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622429c6-aa5b-4363-9831-2912bd2b8c52', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f2f3a8-77e4-4d28-b5e4-377e6ca30df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:41 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Volume volume-622429c6-aa5b-4363-9831-2912bd2b8c52 (622429c6-aa5b-4363-9831-2912bd2b8c52): created successfully
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f2f3a8-77e4-4d28-b5e4-377e6ca30df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:41 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Flow 'volume_create_manager' (e760cb62-0fb7-4ced-bf80-fe35895de2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:38:41 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f06598e6-81df-41d3-9349-5bb475c5ec9f tempest-VolumesTransfersTest-1370403099 None] Created volume successfully.
Sep 17 15:38:42 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-01473864-7843-4528-adb4-98d70124c21a tempest-VolumesTransfersTest-127072034 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-01473864-7843-4528-adb4-98d70124c21a tempest-VolumesTransfersTest-127072034 None] Transfer volume completed successfully.
Sep 17 15:38:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Acquiring lock "cinder-622429c6-aa5b-4363-9831-2912bd2b8c52-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Lock "cinder-622429c6-aa5b-4363-9831-2912bd2b8c52-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:43 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Acquiring lock "cinder-quobyte-622429c6-aa5b-4363-9831-2912bd2b8c52" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Lock "cinder-quobyte-622429c6-aa5b-4363-9831-2912bd2b8c52" acquired by "delete_volume" :: waited 0.019s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:43 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a973cded-3b4f-463a-ae00-ae4e15d60e5a]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:38:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-622429c6-aa5b-4363-9831-2912bd2b8c52 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-622429c6-aa5b-4363-9831-2912bd2b8c52" returned: 0 in 0.374s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-622429c6-aa5b-4363-9831-2912bd2b8c52 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-622429c6-aa5b-4363-9831-2912bd2b8c52" returned: 0 in 0.117s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Lock "cinder-quobyte-622429c6-aa5b-4363-9831-2912bd2b8c52" released by "delete_volume" :: held 0.625s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Created reservations ['3bccfdc7-5799-4553-9622-e2ebb199e385', '5749187a-d03d-4f65-ac7d-448b3f2b3e72', '95a5b0e6-9aea-4914-9b40-01d51ce91f6c', '4cbf84e8-676f-4073-b81f-1f3d11e93ad9'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.171s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:44 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:38:44 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Deleted volume successfully.
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-73064fc1-2f96-479f-8d18-e9ec7871646e tempest-VolumesTransfersTest-482180299 None] Lock "cinder-622429c6-aa5b-4363-9831-2912bd2b8c52-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:45 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Flow 'volume_create_manager' (7abc7b33-a98b-470c-9471-10c0671071af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc045f69-d0fe-461d-acd2-2dcef28ea59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc045f69-d0fe-461d-acd2-2dcef28ea59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-193979748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a30f3ee-c825-49a4-9e94-7c3960db410b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1668462701d8433ea675970e605e898d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:38:45Z,use_quota=True,user_id='e5bbb38af9174bedb95a6b9d4d48b5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8928ba95-97ff-4833-83e6-097d5a4fd313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8928ba95-97ff-4833-83e6-097d5a4fd313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b652a2-cf06-4045-b06b-8b0b2f913666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b652a2-cf06-4045-b06b-8b0b2f913666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a30f3ee-c825-49a4-9e94-7c3960db410b', 'volume_name': 'volume-3a30f3ee-c825-49a4-9e94-7c3960db410b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ccc0dd-2354-4d22-a8ea-fdd16ad76995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ccc0dd-2354-4d22-a8ea-fdd16ad76995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f55edf9-afc6-4729-824c-3ec9dc1c2a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:45 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Volume 3a30f3ee-c825-49a4-9e94-7c3960db410b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a30f3ee-c825-49a4-9e94-7c3960db410b', 'volume_size': 1}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-193979748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a30f3ee-c825-49a4-9e94-7c3960db410b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1668462701d8433ea675970e605e898d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:38:45Z,use_quota=True,user_id='e5bbb38af9174bedb95a6b9d4d48b5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Creating volume 3a30f3ee-c825-49a4-9e94-7c3960db410b {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:38:45 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a30f3ee-c825-49a4-9e94-7c3960db410b 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:45 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=131, name=volume-3a30f3ee-c825-49a4-9e94-7c3960db410b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a30f3ee-c825-49a4-9e94-7c3960db410b 1073741824" returned: 0 in 0.292s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a30f3ee-c825-49a4-9e94-7c3960db410b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a30f3ee-c825-49a4-9e94-7c3960db410b" returned: 0 in 0.085s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] <== create_volume: return (444ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:38:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.457s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f55edf9-afc6-4729-824c-3ec9dc1c2a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a30f3ee-c825-49a4-9e94-7c3960db410b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804f3f0c-16de-4546-b427-a530d5efce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:38:46 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Volume volume-3a30f3ee-c825-49a4-9e94-7c3960db410b (3a30f3ee-c825-49a4-9e94-7c3960db410b): created successfully
Sep 17 15:38:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804f3f0c-16de-4546-b427-a530d5efce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:38:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Flow 'volume_create_manager' (7abc7b33-a98b-470c-9471-10c0671071af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:38:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e7c4662e-5d4f-4f92-9879-759e9d07b4ee tempest-VolumesTransfersTest-1370403099 None] Created volume successfully.
Sep 17 15:38:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Acquiring lock "cinder-3a30f3ee-c825-49a4-9e94-7c3960db410b-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Lock "cinder-3a30f3ee-c825-49a4-9e94-7c3960db410b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:38:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Acquiring lock "cinder-quobyte-3a30f3ee-c825-49a4-9e94-7c3960db410b" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:38:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Lock "cinder-quobyte-3a30f3ee-c825-49a4-9e94-7c3960db410b" acquired by "delete_volume" :: waited 0.013s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:38:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d293b9-17b3-4796-9f0f-97b4598fa9bb]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:38:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a30f3ee-c825-49a4-9e94-7c3960db410b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a30f3ee-c825-49a4-9e94-7c3960db410b" returned: 0 in 0.380s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a30f3ee-c825-49a4-9e94-7c3960db410b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a30f3ee-c825-49a4-9e94-7c3960db410b" returned: 0 in 0.115s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Lock "cinder-quobyte-3a30f3ee-c825-49a4-9e94-7c3960db410b" released by "delete_volume" :: held 0.628s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Created reservations ['1f4741f3-3475-4fc7-8012-581f7a720055', '28523411-efaa-4369-b0db-7a1e7f0bafcc', '14bd94b2-e523-4ed4-b468-a993dab81c0d', '7066691a-0245-4363-bb99-da86ac8276bc'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:38:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:38:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:38:49 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:38:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Deleted volume successfully.
Sep 17 15:38:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-328a299f-10ef-4861-b030-99e0c5642dc6 tempest-VolumesTransfersTest-482180299 None] Lock "cinder-3a30f3ee-c825-49a4-9e94-7c3960db410b-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:38:58 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=20,cinder:INSERT=8,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:38:59 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=40,cinder:UPDATE=50,cinder:DELETE=6,cinder:INSERT=8 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:39:05 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Flow 'volume_create_manager' (06e9e766-f100-432d-ac72-a5db85299a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502a3541-3037-47dd-92d4-3d7914568d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502a3541-3037-47dd-92d4-3d7914568d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-47435339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0efa100-98ea-4e18-b791-e24502f8ab07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3907a2e7c2c54445981c02dd86ba85d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:39:05Z,use_quota=True,user_id='20545584d5df4b31a9d10b182c926b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896defb8-c175-43b0-aaa4-451607189dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896defb8-c175-43b0-aaa4-451607189dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4424c7-18fa-4db2-ad26-7bdf9ddb5bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4424c7-18fa-4db2-ad26-7bdf9ddb5bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0efa100-98ea-4e18-b791-e24502f8ab07', 'volume_name': 'volume-f0efa100-98ea-4e18-b791-e24502f8ab07', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60ed965-35ee-4eb4-ae16-7ad4b65fbbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60ed965-35ee-4eb4-ae16-7ad4b65fbbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cfb0e-dcba-407a-aebc-aac3c5bca266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:39:05 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Volume f0efa100-98ea-4e18-b791-e24502f8ab07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0efa100-98ea-4e18-b791-e24502f8ab07', 'volume_size': 1}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-47435339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0efa100-98ea-4e18-b791-e24502f8ab07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3907a2e7c2c54445981c02dd86ba85d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:39:05Z,use_quota=True,user_id='20545584d5df4b31a9d10b182c926b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Creating volume f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:39:05 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:39:05 devstack quobyte-client[83236]: System call of process 96984 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:39:05 devstack quobyte-client[83236]: System call of process 96984 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:39:05 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=132, name=volume-f0efa100-98ea-4e18-b791-e24502f8ab07, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 1073741824" returned: 0 in 0.310s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07" returned: 0 in 0.087s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] <== create_volume: return (458ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:39:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.470s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:39:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cfb0e-dcba-407a-aebc-aac3c5bca266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0efa100-98ea-4e18-b791-e24502f8ab07', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:39:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a560da8a-a275-4e74-bcca-874d0bf6b242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:39:06 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Volume volume-f0efa100-98ea-4e18-b791-e24502f8ab07 (f0efa100-98ea-4e18-b791-e24502f8ab07): created successfully
Sep 17 15:39:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a560da8a-a275-4e74-bcca-874d0bf6b242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:39:06 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Flow 'volume_create_manager' (06e9e766-f100-432d-ac72-a5db85299a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:39:06 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-0e67a5d4-1f3f-4478-bf4e-b20936f3bd89 tempest-VolumesActionsTest-1586844691 None] Created volume successfully.
Sep 17 15:39:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:39:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:39:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:39:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:39:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:39:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:39:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:39:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.102s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:39:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:39:15 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:39:16 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:39:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-57fd29a9-dafc-43d1-bace-8f0fb0277849 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07" by "attach_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:39:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-57fd29a9-dafc-43d1-bace-8f0fb0277849 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07" acquired by "attach_volume" :: waited 0.022s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:39:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-57fd29a9-dafc-43d1-bace-8f0fb0277849 tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:39:30 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-57fd29a9-dafc-43d1-bace-8f0fb0277849 tempest-VolumesActionsTest-1586844691 None] Attaching volume f0efa100-98ea-4e18-b791-e24502f8ab07 to instance af49d5f5-fe11-4c6a-9181-3f018974c909 at mountpoint /dev/vdb on host None.
Sep 17 15:39:31 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-57fd29a9-dafc-43d1-bace-8f0fb0277849 tempest-VolumesActionsTest-1586844691 None] Attach volume completed successfully.
Sep 17 15:39:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-57fd29a9-dafc-43d1-bace-8f0fb0277849 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07" released by "attach_volume" :: held 0.275s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:39:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-87808f8e-7caf-4ec8-bc23-7aa2b8083449 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07-detach_volume" by "detach_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:39:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-87808f8e-7caf-4ec8-bc23-7aa2b8083449 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:39:31 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-87808f8e-7caf-4ec8-bc23-7aa2b8083449 tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:39:31 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-87808f8e-7caf-4ec8-bc23-7aa2b8083449 tempest-VolumesActionsTest-1586844691 None] Detaching volume f0efa100-98ea-4e18-b791-e24502f8ab07 from instance af49d5f5-fe11-4c6a-9181-3f018974c909.
Sep 17 15:39:31 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-87808f8e-7caf-4ec8-bc23-7aa2b8083449 tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:39:31 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-87808f8e-7caf-4ec8-bc23-7aa2b8083449 tempest-VolumesActionsTest-1586844691 None] Detach volume completed successfully.
Sep 17 15:39:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-87808f8e-7caf-4ec8-bc23-7aa2b8083449 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:39:41 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:39:41 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:40:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d631d8a4-e496-4585-aefd-d91d78dfa050 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07" by "attach_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:40:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d631d8a4-e496-4585-aefd-d91d78dfa050 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07" acquired by "attach_volume" :: waited 0.016s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:40:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-d631d8a4-e496-4585-aefd-d91d78dfa050 tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:40:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d631d8a4-e496-4585-aefd-d91d78dfa050 tempest-VolumesActionsTest-1586844691 None] Attaching volume f0efa100-98ea-4e18-b791-e24502f8ab07 to instance 00d59e98-4005-4c6c-91ee-eea1e1b78eae at mountpoint /dev/vdb on host None.
Sep 17 15:40:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-d631d8a4-e496-4585-aefd-d91d78dfa050 tempest-VolumesActionsTest-1586844691 None] Attach volume completed successfully.
Sep 17 15:40:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-d631d8a4-e496-4585-aefd-d91d78dfa050 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07" released by "attach_volume" :: held 0.205s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:40:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-911e555f-c36d-4a8a-87bc-867491a1d35e tempest-VolumesActionsTest-1586844691 None] Acquiring lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07-detach_volume" by "detach_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:40:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-911e555f-c36d-4a8a-87bc-867491a1d35e tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:40:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-911e555f-c36d-4a8a-87bc-867491a1d35e tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:40:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-911e555f-c36d-4a8a-87bc-867491a1d35e tempest-VolumesActionsTest-1586844691 None] Detaching volume f0efa100-98ea-4e18-b791-e24502f8ab07 from instance 00d59e98-4005-4c6c-91ee-eea1e1b78eae.
Sep 17 15:40:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-911e555f-c36d-4a8a-87bc-867491a1d35e tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:40:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-911e555f-c36d-4a8a-87bc-867491a1d35e tempest-VolumesActionsTest-1586844691 None] Detach volume completed successfully.
Sep 17 15:40:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-911e555f-c36d-4a8a-87bc-867491a1d35e tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:40:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:40:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:40:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:40:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:40:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:40:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:40:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.125s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:40:13 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:INSERT=2,cinder:SELECT=8,cinder:UPDATE=3 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:40:13 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:40:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:40:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:40:13 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f75304d-9f1e-4249-8a75-a97e03cca2c3]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:40:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07" returned: 0 in 0.403s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:14 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a1a6e5-4e31-41ad-ae6f-cdb85912d1ad]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:40:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07" returned: 0 in 0.376s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.d7cba853-0f23-4b3b-9de0-a654c0c9499ejvjptlrk.img {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:40:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.d7cba853-0f23-4b3b-9de0-a654c0c9499ejvjptlrk.img" returned: 0 in 4.651s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:19 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d3ee96-b024-4075-af09-3fc8ad19e9c2]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:40:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07" returned: 0 in 0.567s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:19 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Image conversion details: src /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.d7cba853-0f23-4b3b-9de0-a654c0c9499ejvjptlrk.img {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:40:19 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Converted 1024.00 MB image at 219.82 MB/s
Sep 17 15:40:19 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] d7cba853-0f23-4b3b-9de0-a654c0c9499e was raw, no need to convert to raw {{(pid=83214) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 17 15:40:23 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:40:29 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:40:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.871s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:40:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Uploaded volume to glance image-id: d7cba853-0f23-4b3b-9de0-a654c0c9499e. {{(pid=83214) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 17 15:40:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-852e4ee8-b5f8-4e3e-8a50-ce75ba30fe41 tempest-VolumesActionsTest-1586844691 None] Copy volume to image completed successfully.
Sep 17 15:40:52 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:40:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:40:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:40:52 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5a5395-870c-4635-9e51-d34804357ec7]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:40:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07" returned: 0 in 0.399s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:53 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab2547b-b3b7-4137-ab57-2a24f52449f7]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:40:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07" returned: 0 in 0.396s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img" returned: 0 in 4.853s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:58 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c63b47a-fe4d-49f4-b05c-c89129740c3f]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:40:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07" returned: 0 in 0.551s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:59 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Image conversion details: src /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:40:59 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Converted 1024.00 MB image at 209.77 MB/s
Sep 17 15:40:59 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] bdc5f6d7-f58d-4c86-beca-dad3105cfc3e was raw, converting to qcow2 {{(pid=83214) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 17 15:40:59 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2b5b8a-c25c-46d7-bb3d-38e5b289fae7]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:40:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:40:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img" returned: 0 in 0.322s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:40:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img" returned: 1 in 0.331s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:41:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img /opt/stack/data/cinder/conversion/vol_upload_d20eekyk {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img /opt/stack/data/cinder/conversion/vol_upload_d20eekyk" returned: 0 in 0.132s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:00 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Image conversion details: src /opt/stack/data/cinder/conversion/f0efa100-98ea-4e18-b791-e24502f8ab07.temp_image.bdc5f6d7-f58d-4c86-beca-dad3105cfc3ekk_vv_54.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_d20eekyk {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:41:00 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 17 15:41:00 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c00e07-bc2e-456a-ad17-fb0f9d440893]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d20eekyk {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d20eekyk" returned: 0 in 0.362s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.947s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Uploaded volume to glance image-id: bdc5f6d7-f58d-4c86-beca-dad3105cfc3e. {{(pid=83214) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 17 15:41:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a917f617-3d12-4b70-9920-f9f008c8d596 tempest-VolumesActionsTest-1586844691 None] Copy volume to image completed successfully.
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:41:03 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "cinder-quobyte-f0efa100-98ea-4e18-b791-e24502f8ab07" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-quobyte-f0efa100-98ea-4e18-b791-e24502f8ab07" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[e424f395-10ac-42a0-9f1e-2c57b5e1f3d5]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07" returned: 0 in 0.384s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f0efa100-98ea-4e18-b791-e24502f8ab07" returned: 0 in 0.107s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-quobyte-f0efa100-98ea-4e18-b791-e24502f8ab07" released by "delete_volume" :: held 0.622s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Created reservations ['2cc718e5-7f82-40ab-b344-c4d6af230a7e', 'f6829bc2-7c41-41e4-a4ae-0bef9bb258bd', '699602ad-8c74-4cc0-b097-9f53477a232f', '37d14591-7e8f-4c94-a862-6008a6cb6823'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.116s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:41:04 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Deleted volume successfully.
Sep 17 15:41:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0a1be58d-befb-447b-953f-765215e3cb42 tempest-VolumesActionsTest-1586844691 None] Lock "cinder-f0efa100-98ea-4e18-b791-e24502f8ab07-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:41:11 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Flow 'volume_create_manager' (15aa0809-8ae4-4735-940b-1891d1b20a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee63e83-31b2-44a8-857f-067db03843b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee63e83-31b2-44a8-857f-067db03843b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1634537092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ae588f-3f1d-4ae3-808b-677865e59e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095b0b7d83924ff7900e3ec076c78c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:41:11Z,use_quota=True,user_id='af382e1c321549e99ab50284247d5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae40c4f-9664-40c4-b752-94768c785146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae40c4f-9664-40c4-b752-94768c785146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4626d8a5-7d4d-44ca-b920-5c97310afe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.image.glance [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Creating Keystone auth plugin from conf {{(pid=83214) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4626d8a5-7d4d-44ca-b920-5c97310afe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40ae588f-3f1d-4ae3-808b-677865e59e24', 'volume_name': 'volume-40ae588f-3f1d-4ae3-808b-677865e59e24', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a91ab0a0>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e604d7-5fb5-4b04-8227-671b6415febd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e604d7-5fb5-4b04-8227-671b6415febd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ddf9f9-1ad6-4035-ac28-5d21acae836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:11 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Volume 40ae588f-3f1d-4ae3-808b-677865e59e24: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40ae588f-3f1d-4ae3-808b-677865e59e24', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a91ab0a0>}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Cloning 40ae588f-3f1d-4ae3-808b-677865e59e24 from image 1365088a-6d64-46d1-8e72-c667035bafb6  at location (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]). {{(pid=83214) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 15:41:11 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9579af2e-c7a2-43d9-a592-7e23b9c3b271]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:41:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:41:12 devstack sudo[97473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD
Sep 17 15:41:12 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:41:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:41:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.135s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:41:13 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root
Sep 17 15:41:13 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD" returned: 0 in 1.974s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:13 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Temporary image 1365088a-6d64-46d1-8e72-c667035bafb6 is fetched for user af382e1c321549e99ab50284247d5080. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 15:41:14 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8063b1-10fd-4929-9c0c-814ce02672f9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:14 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:14 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD
Sep 17 15:41:14 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:41:16 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD" returned: 0 in 1.875s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1634537092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ae588f-3f1d-4ae3-808b-677865e59e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095b0b7d83924ff7900e3ec076c78c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:41:11Z,use_quota=True,user_id='af382e1c321549e99ab50284247d5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Creating volume 40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:41:16 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:16 devstack quobyte-client[83236]: System call of process 97485 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:41:16 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=133, name=volume-40ae588f-3f1d-4ae3-808b-677865e59e24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 1073741824" returned: 0 in 0.308s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] <== create_volume: return (471ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.499s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Attempting download of 1365088a-6d64-46d1-8e72-c667035bafb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}])) to volume 40ae588f-3f1d-4ae3-808b-677865e59e24. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4477741a-b692-4fa1-b136-1b4cca89a7fb]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_5go91tyv {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_5go91tyv" returned: 0 in 0.339s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_5go91tyv {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_5go91tyv" returned: 1 in 0.331s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_5go91tyv' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:41:17 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eeca9d-330e-44c2-97cf-2be65f435eaf]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:18 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] 1365088a-6d64-46d1-8e72-c667035bafb6 was qcow2, converting to raw {{(pid=83214) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 15:41:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:18 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=133, name=volume-40ae588f-3f1d-4ae3-808b-677865e59e24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:41:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24" returned: 0 in 0.850s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:18 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_jztqwaezdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:41:18 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Converted 112.00 MB image at 112.00 MB/s
Sep 17 15:41:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 1G" returned: 0 in 0.119s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:19 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a283477d-81f7-4ae6-b814-0e9a58902a8c]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24" returned: 0 in 0.331s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24" returned: 1 in 0.360s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:41:19 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Downloaded image 1365088a-6d64-46d1-8e72-c667035bafb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}])) to volume 40ae588f-3f1d-4ae3-808b-677865e59e24 successfully. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Temporary image 1365088a-6d64-46d1-8e72-c667035bafb6 for user af382e1c321549e99ab50284247d5080 is deleted. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Marking volume 40ae588f-3f1d-4ae3-808b-677865e59e24 as bootable. {{(pid=83214) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Copying metadata from image 1365088a-6d64-46d1-8e72-c667035bafb6 to 40ae588f-3f1d-4ae3-808b-677865e59e24. {{(pid=83214) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Creating volume glance metadata for volume 40ae588f-3f1d-4ae3-808b-677865e59e24 backed by image 1365088a-6d64-46d1-8e72-c667035bafb6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83214) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ddf9f9-1ad6-4035-ac28-5d21acae836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ae588f-3f1d-4ae3-808b-677865e59e24', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a91ab0a0>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c196de30-3dc6-4db3-b7ac-7af557ba7671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:20 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Volume volume-40ae588f-3f1d-4ae3-808b-677865e59e24 (40ae588f-3f1d-4ae3-808b-677865e59e24): created successfully
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c196de30-3dc6-4db3-b7ac-7af557ba7671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Flow 'volume_create_manager' (15aa0809-8ae4-4735-940b-1891d1b20a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:41:20 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-374509b0-068f-466a-a800-c3c551983188 tempest-VolumesExtendTest-924994367 None] Created volume successfully.
Sep 17 15:41:20 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e21d81-365a-4c41-b772-b230052dc55e]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24" returned: 0 in 0.346s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24" returned: 1 in 0.378s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:41:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 2G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 2G" returned: 0 in 0.112s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:22 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b6723687-1e6c-4e9f-98f4-a8674de56238 tempest-VolumesExtendTest-924994367 None] Extend volume completed successfully.
Sep 17 15:41:23 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Acquiring lock "cinder-40ae588f-3f1d-4ae3-808b-677865e59e24-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:41:23 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Lock "cinder-40ae588f-3f1d-4ae3-808b-677865e59e24-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:41:23 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:41:23 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Acquiring lock "cinder-quobyte-40ae588f-3f1d-4ae3-808b-677865e59e24" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:41:23 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Lock "cinder-quobyte-40ae588f-3f1d-4ae3-808b-677865e59e24" acquired by "delete_volume" :: waited 0.016s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:41:23 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf95ce-e858-409c-9074-23ab656503ca]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24" returned: 0 in 0.494s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24" returned: 1 in 0.422s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:41:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-40ae588f-3f1d-4ae3-808b-677865e59e24" returned: 0 in 0.077s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:24 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Lock "cinder-quobyte-40ae588f-3f1d-4ae3-808b-677865e59e24" released by "delete_volume" :: held 1.245s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Created reservations ['bc5e83b0-00ab-428f-806e-8e09890807a0', 'da636a43-86ad-4c72-b158-a759397f186c', '8c300b9f-199f-408f-a28c-d011b479b348', 'c417ecce-49b3-4f51-8bb8-cdeee6df4346'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:41:25 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Deleted volume successfully.
Sep 17 15:41:25 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3ac460a9-d4f8-4cee-89fc-da2ff7343d9f tempest-VolumesExtendTest-924994367 None] Lock "cinder-40ae588f-3f1d-4ae3-808b-677865e59e24-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:41:26 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Flow 'volume_create_manager' (ffb45a4d-b4f8-4007-8861-0011c939a3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e0c50a-186a-4a36-b6ee-0c6223eb11eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e0c50a-186a-4a36-b6ee-0c6223eb11eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-424937422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112a6be4-5f61-4fae-b24f-89598af2b302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095b0b7d83924ff7900e3ec076c78c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:41:26Z,use_quota=True,user_id='af382e1c321549e99ab50284247d5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920b98e3-c09a-4de5-9714-6dbe109437dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920b98e3-c09a-4de5-9714-6dbe109437dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed954f2-f46f-4047-86c5-706578840cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed954f2-f46f-4047-86c5-706578840cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '112a6be4-5f61-4fae-b24f-89598af2b302', 'volume_name': 'volume-112a6be4-5f61-4fae-b24f-89598af2b302', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3488761e-6dd2-4043-93fc-61c3471e4407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3488761e-6dd2-4043-93fc-61c3471e4407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f4d5e5-8820-4aab-b2fd-32b3bc93d5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:26 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Volume 112a6be4-5f61-4fae-b24f-89598af2b302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-112a6be4-5f61-4fae-b24f-89598af2b302', 'volume_size': 1}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-424937422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112a6be4-5f61-4fae-b24f-89598af2b302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095b0b7d83924ff7900e3ec076c78c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:41:26Z,use_quota=True,user_id='af382e1c321549e99ab50284247d5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Creating volume 112a6be4-5f61-4fae-b24f-89598af2b302 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:41:26 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:26 devstack quobyte-client[83236]: System call of process 97559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:41:26 devstack quobyte-client[83236]: System call of process 97559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:41:26 devstack quobyte-client[83236]: System call of process 97559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:41:26 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=134, name=volume-112a6be4-5f61-4fae-b24f-89598af2b302, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 1073741824" returned: 0 in 0.305s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302" returned: 0 in 0.083s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] <== create_volume: return (452ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.465s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f4d5e5-8820-4aab-b2fd-32b3bc93d5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-112a6be4-5f61-4fae-b24f-89598af2b302', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800efe5d-2375-4502-a64e-ed49acaa68b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:41:26 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Volume volume-112a6be4-5f61-4fae-b24f-89598af2b302 (112a6be4-5f61-4fae-b24f-89598af2b302): created successfully
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800efe5d-2375-4502-a64e-ed49acaa68b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:41:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Flow 'volume_create_manager' (ffb45a4d-b4f8-4007-8861-0011c939a3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:41:27 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-1c3634ee-61f2-4a75-ba1b-b7b711a935d7 tempest-VolumesExtendTest-924994367 None] Created volume successfully.
Sep 17 15:41:28 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:41:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Creating offline snapshot 8f25c410-0e9a-480c-bcb1-ec8cba5b1215 of volume 112a6be4-5f61-4fae-b24f-89598af2b302 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:41:28 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[debf4091-6fa6-4a81-a3f4-8615cf64a24e]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302" returned: 0 in 0.440s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:29 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=135, name=volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 1G" returned: 0 in 0.221s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): qemu-img rebase -u -b volume-112a6be4-5f61-4fae-b24f-89598af2b302 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] CMD "qemu-img rebase -u -b volume-112a6be4-5f61-4fae-b24f-89598af2b302 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215" returned: 0 in 0.122s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215" returned: 0 in 0.084s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215" returned: 0 in 0.112s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.info" returned: 0 in 0.084s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.info" returned: 0 in 0.079s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.443s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:30 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-35ea7ba2-35f6-4ed2-9fc0-c65a9caba24d tempest-VolumesExtendTest-924994367 None] Create snapshot completed successfully
Sep 17 15:41:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-6ad83ef1-3c2f-4677-80a3-d61d5927fd94 tempest-VolumesExtendTest-924994367 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:41:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6ad83ef1-3c2f-4677-80a3-d61d5927fd94 tempest-VolumesExtendTest-924994367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6ad83ef1-3c2f-4677-80a3-d61d5927fd94 tempest-VolumesExtendTest-924994367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:30 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fe8506-6eee-4cc7-9df1-bd62a3db4e92]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6ad83ef1-3c2f-4677-80a3-d61d5927fd94 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6ad83ef1-3c2f-4677-80a3-d61d5927fd94 tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302" returned: 0 in 0.427s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6ad83ef1-3c2f-4677-80a3-d61d5927fd94 tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 2G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:31 devstack quobyte-client[83236]: System call of process 97579 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-6ad83ef1-3c2f-4677-80a3-d61d5927fd94 tempest-VolumesExtendTest-924994367 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 2G" returned: 0 in 0.172s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-6ad83ef1-3c2f-4677-80a3-d61d5927fd94 tempest-VolumesExtendTest-924994367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.685s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:31 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-6ad83ef1-3c2f-4677-80a3-d61d5927fd94 tempest-VolumesExtendTest-924994367 None] Extend volume completed successfully.
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Acquiring lock "cinder-8f25c410-0e9a-480c-bcb1-ec8cba5b1215-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Lock "cinder-8f25c410-0e9a-480c-bcb1-ec8cba5b1215-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:41:31 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Acquiring lock "cinder-quobyte-112a6be4-5f61-4fae-b24f-89598af2b302" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Lock "cinder-quobyte-112a6be4-5f61-4fae-b24f-89598af2b302" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Acquiring lock "cinder-quobyte-8f25c410-0e9a-480c-bcb1-ec8cba5b1215" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Lock "cinder-quobyte-8f25c410-0e9a-480c-bcb1-ec8cba5b1215" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Deleting offline snapshot 8f25c410-0e9a-480c-bcb1-ec8cba5b1215 of volume 112a6be4-5f61-4fae-b24f-89598af2b302 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] snapshot_file for this snap is: volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:41:31 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafc342e-ce1c-4288-854f-4a9de81a7643]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215" returned: 0 in 0.363s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112a6be4-5f61-4fae-b24f-89598af2b302(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:41:32 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebfd323-2b6f-46ea-8a0a-77172dcc4117]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302" returned: 0 in 0.381s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215" returned: 0 in 0.252s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302.8f25c410-0e9a-480c-bcb1-ec8cba5b1215" returned: 0 in 0.084s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Lock "cinder-quobyte-8f25c410-0e9a-480c-bcb1-ec8cba5b1215" released by "_delete_snapshot" :: held 1.344s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:41:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Lock "cinder-quobyte-112a6be4-5f61-4fae-b24f-89598af2b302" released by "delete_snapshot" :: held 1.367s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:41:33 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Created reservations ['9a1be589-9870-4123-be52-a4d3aea85999', 'ca66e5ca-b901-4292-955f-e63af90c8418', 'f09dbb3a-4a6f-4319-9a9f-04b3f2254af4', 'de37e9af-33c0-4c82-ad72-612e6a0feb1f'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:41:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Delete snapshot completed successfully.
Sep 17 15:41:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-f31feadf-49f9-47ab-af3e-acdd3872945d tempest-VolumesExtendTest-924994367 None] Lock "cinder-8f25c410-0e9a-480c-bcb1-ec8cba5b1215-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Acquiring lock "cinder-112a6be4-5f61-4fae-b24f-89598af2b302-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Lock "cinder-112a6be4-5f61-4fae-b24f-89598af2b302-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:41:34 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Acquiring lock "cinder-quobyte-112a6be4-5f61-4fae-b24f-89598af2b302" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Lock "cinder-quobyte-112a6be4-5f61-4fae-b24f-89598af2b302" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[129a888f-aae5-4502-ae5f-18b19bd086e0]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302" returned: 0 in 0.377s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-112a6be4-5f61-4fae-b24f-89598af2b302" returned: 0 in 0.116s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Lock "cinder-quobyte-112a6be4-5f61-4fae-b24f-89598af2b302" released by "delete_volume" :: held 0.634s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Created reservations ['bffaa16b-b2f5-4b69-b97d-0ccbf1ace359', '11eac794-6941-4201-8d3d-c5ae0bce4844', '585e7bd3-dee4-4f03-82f2-f1c9ef9baf62', '86cfd70a-922d-4162-b4dd-5fe7ff275429'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.233s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:41:35 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Deleted volume successfully.
Sep 17 15:41:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9546b96c-32e5-4509-a0b2-b908072b0b5e tempest-VolumesExtendTest-924994367 None] Lock "cinder-112a6be4-5f61-4fae-b24f-89598af2b302-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:41:45 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=32,cinder:SELECT=32,cinder:INSERT=17,cinder:DELETE=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:41:45 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=40,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:42:00 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Flow 'volume_create_manager' (ff902b61-3376-4b1e-92c9-c76dd2bf0199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e401f6-d66c-49e5-b296-6e5292e6a076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e401f6-d66c-49e5-b296-6e5292e6a076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1165935661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a27275f-3f3d-440a-ae29-4e84a7035868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43640049cb6f4854b516d1e05c3bd316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:42:00Z,use_quota=True,user_id='07d81bffb53b4f2a897eff34671a0aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbb2b48d-4b1d-41d7-91b9-cef5e3e32af1),volume_type_id=bbb2b48d-4b1d-41d7-91b9-cef5e3e32af1)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795631d4-3f6c-4469-9010-986e72dc86b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795631d4-3f6c-4469-9010-986e72dc86b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1361c87-c137-497f-b933-ed0403af7d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1361c87-c137-497f-b933-ed0403af7d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a27275f-3f3d-440a-ae29-4e84a7035868', 'volume_name': 'volume-3a27275f-3f3d-440a-ae29-4e84a7035868', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455aed4a-a3ad-4780-9d8e-994bc54bb315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455aed4a-a3ad-4780-9d8e-994bc54bb315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1298f3-21f9-4567-9683-7ea6d7d46732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:00 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume 3a27275f-3f3d-440a-ae29-4e84a7035868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a27275f-3f3d-440a-ae29-4e84a7035868', 'volume_size': 1}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1165935661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a27275f-3f3d-440a-ae29-4e84a7035868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43640049cb6f4854b516d1e05c3bd316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:42:00Z,use_quota=True,user_id='07d81bffb53b4f2a897eff34671a0aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbb2b48d-4b1d-41d7-91b9-cef5e3e32af1),volume_type_id=bbb2b48d-4b1d-41d7-91b9-cef5e3e32af1)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Creating volume 3a27275f-3f3d-440a-ae29-4e84a7035868 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:42:00 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:42:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:00 devstack quobyte-client[83236]: System call of process 97603 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:42:00 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=137, name=volume-3a27275f-3f3d-440a-ae29-4e84a7035868, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868 1073741824" returned: 0 in 0.571s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:01 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Flow 'volume_create_manager' (b4b15dfa-6260-4a9d-90c5-5d55880deea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfa0ed6-33d8-4782-ba06-e0ce41d4f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868" returned: 0 in 0.537s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] <== create_volume: return (1165ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfa0ed6-33d8-4782-ba06-e0ce41d4f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1436641074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274cde1a-2e19-4d3b-a2c6-9e77874edcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43640049cb6f4854b516d1e05c3bd316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:42:01Z,use_quota=True,user_id='07d81bffb53b4f2a897eff34671a0aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1590dd9-8c77-42a7-b25b-15be229df3fb),volume_type_id=e1590dd9-8c77-42a7-b25b-15be229df3fb)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f8d7d-e02d-435c-8fe1-da472c9361aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f8d7d-e02d-435c-8fe1-da472c9361aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb24ad35-19ef-46c9-a225-8c6a082d65c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb24ad35-19ef-46c9-a225-8c6a082d65c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274cde1a-2e19-4d3b-a2c6-9e77874edcc6', 'volume_name': 'volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d161c2-9420-4c84-b75e-de3340d2c3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d161c2-9420-4c84-b75e-de3340d2c3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea73cbd0-4a6d-4dc3-8bf0-4b8de61d5a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:01 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume 274cde1a-2e19-4d3b-a2c6-9e77874edcc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6', 'volume_size': 1}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:42:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1436641074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274cde1a-2e19-4d3b-a2c6-9e77874edcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43640049cb6f4854b516d1e05c3bd316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:42:01Z,use_quota=True,user_id='07d81bffb53b4f2a897eff34671a0aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1590dd9-8c77-42a7-b25b-15be229df3fb),volume_type_id=e1590dd9-8c77-42a7-b25b-15be229df3fb)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Creating volume 274cde1a-2e19-4d3b-a2c6-9e77874edcc6 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:42:02 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:02 devstack quobyte-client[83236]: System call of process 97613 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:42:02 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=138, name=volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1298f3-21f9-4567-9683-7ea6d7d46732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a27275f-3f3d-440a-ae29-4e84a7035868', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002d28bf-c16e-4144-9e04-8cbe6d9a16c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6 1073741824" returned: 0 in 0.411s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:02 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume volume-3a27275f-3f3d-440a-ae29-4e84a7035868 (3a27275f-3f3d-440a-ae29-4e84a7035868): created successfully
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002d28bf-c16e-4144-9e04-8cbe6d9a16c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Flow 'volume_create_manager' (ff902b61-3376-4b1e-92c9-c76dd2bf0199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:42:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Flow 'volume_create_manager' (c8b19804-bf0b-4432-b2fb-ee3fa0c3efe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f068b6-7180-45fc-a0ef-076a419105b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6" returned: 0 in 0.437s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] <== create_volume: return (864ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f068b6-7180-45fc-a0ef-076a419105b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1940637701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446a9d5f-86ca-40f0-a9f4-171e2b82abec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43640049cb6f4854b516d1e05c3bd316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:42:02Z,use_quota=True,user_id='07d81bffb53b4f2a897eff34671a0aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41ad3b01-eabe-4019-8432-7c589b60e3fd),volume_type_id=41ad3b01-eabe-4019-8432-7c589b60e3fd)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fbc12b-3a9f-49f7-8f21-2c7cd5e33ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fbc12b-3a9f-49f7-8f21-2c7cd5e33ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c82724-02cd-4780-846c-727df4747ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.image.glance [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Creating Keystone auth plugin from conf {{(pid=83214) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 15:42:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b93cc16a-6294-4820-a176-2213f5735543 tempest-TestInstancesWithCinderVolumes-1611491097 None] Created volume successfully.
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea73cbd0-4a6d-4dc3-8bf0-4b8de61d5a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ab86a6-a795-49de-b213-04ec9573ad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:03 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6 (274cde1a-2e19-4d3b-a2c6-9e77874edcc6): created successfully
Sep 17 15:42:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ab86a6-a795-49de-b213-04ec9573ad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Flow 'volume_create_manager' (b4b15dfa-6260-4a9d-90c5-5d55880deea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:42:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-1d946817-85a4-4d9a-aca2-2f535864c009 tempest-TestInstancesWithCinderVolumes-1611491097 None] Created volume successfully.
Sep 17 15:42:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c82724-02cd-4780-846c-727df4747ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '446a9d5f-86ca-40f0-a9f4-171e2b82abec', 'volume_name': 'volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec', 'volume_size': 1, 'image_id': '44ed0884-61d3-4282-ab57-0ca406d243d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44ed0884-61d3-4282-ab57-0ca406d243d3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--827230200', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43640049cb6f4854b516d1e05c3bd316', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44ed0884-61d3-4282-ab57-0ca406d243d3', 'created_at': datetime.datetime(2025, 9, 17, 13, 41, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44ed0884-61d3-4282-ab57-0ca406d243d3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9065090>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c285e94-695d-4095-baf3-e0204890240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c285e94-695d-4095-baf3-e0204890240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:03 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954c600e-afb8-469d-a829-ef7abf010745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:03 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume 446a9d5f-86ca-40f0-a9f4-171e2b82abec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec', 'volume_size': 1, 'image_id': '44ed0884-61d3-4282-ab57-0ca406d243d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44ed0884-61d3-4282-ab57-0ca406d243d3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--827230200', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43640049cb6f4854b516d1e05c3bd316', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44ed0884-61d3-4282-ab57-0ca406d243d3', 'created_at': datetime.datetime(2025, 9, 17, 13, 41, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44ed0884-61d3-4282-ab57-0ca406d243d3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9065090>}
Sep 17 15:42:03 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Cloning 446a9d5f-86ca-40f0-a9f4-171e2b82abec from image 44ed0884-61d3-4282-ab57-0ca406d243d3  at location (None, [{'url': 'file:///opt/stack/data/glance/images/44ed0884-61d3-4282-ab57-0ca406d243d3', 'metadata': {}}]). {{(pid=83214) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 15:42:04 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD, size 20.69 MB, duration 1.31 sec {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 15:42:04 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Image download 20.69 MB at 15.84 MB/s
Sep 17 15:42:04 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b888f94e-88b1-41da-a0a1-e559af2283c7]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:42:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:04 devstack sudo[97617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD
Sep 17 15:42:04 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:42:06 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root
Sep 17 15:42:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD" returned: 0 in 1.852s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:06 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Temporary image 44ed0884-61d3-4282-ab57-0ca406d243d3 is fetched for user 07d81bffb53b4f2a897eff34671a0aca. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 15:42:06 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9119d867-0b7d-40c3-92bc-51d5cf3c7f64]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:42:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:07 devstack sudo[97623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD
Sep 17 15:42:07 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:42:08 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD" returned: 0 in 1.919s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1940637701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446a9d5f-86ca-40f0-a9f4-171e2b82abec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43640049cb6f4854b516d1e05c3bd316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:42:02Z,use_quota=True,user_id='07d81bffb53b4f2a897eff34671a0aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41ad3b01-eabe-4019-8432-7c589b60e3fd),volume_type_id=41ad3b01-eabe-4019-8432-7c589b60e3fd)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Creating volume 446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:42:08 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:42:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:08 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=139, name=volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec 1073741824" returned: 0 in 0.286s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec" returned: 0 in 0.087s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] <== create_volume: return (456ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.482s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Attempting download of 44ed0884-61d3-4282-ab57-0ca406d243d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/44ed0884-61d3-4282-ab57-0ca406d243d3', 'metadata': {}}])) to volume 446a9d5f-86ca-40f0-a9f4-171e2b82abec. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ba59a5-b58d-4997-8f03-916ad5d96ff4]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44ed0884-61d3-4282-ab57-0ca406d243d3_izgtce4y {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44ed0884-61d3-4282-ab57-0ca406d243d3_izgtce4y" returned: 0 in 0.336s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44ed0884-61d3-4282-ab57-0ca406d243d3_izgtce4y {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44ed0884-61d3-4282-ab57-0ca406d243d3_izgtce4y" returned: 1 in 0.325s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44ed0884-61d3-4282-ab57-0ca406d243d3_izgtce4y' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:42:10 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c32226-33d3-4f6a-88dd-c5babddf9a44]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:42:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:10 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] 44ed0884-61d3-4282-ab57-0ca406d243d3 was qcow2, converting to raw {{(pid=83214) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 15:42:10 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:10 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=139, name=volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:42:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec" returned: 0 in 0.828s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:11 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_44ed0884-61d3-4282-ab57-0ca406d243d3_nu6q4f2adevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:42:11 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Converted 112.00 MB image at 112.00 MB/s
Sep 17 15:42:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec 1G" returned: 0 in 0.113s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:11 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[21767ed4-1c76-46e7-9516-0515e1c597a3]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:42:11 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec" returned: 0 in 0.345s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec" returned: 1 in 0.406s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.147s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Downloaded image 44ed0884-61d3-4282-ab57-0ca406d243d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/44ed0884-61d3-4282-ab57-0ca406d243d3', 'metadata': {}}])) to volume 446a9d5f-86ca-40f0-a9f4-171e2b82abec successfully. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Temporary image 44ed0884-61d3-4282-ab57-0ca406d243d3 for user 07d81bffb53b4f2a897eff34671a0aca is deleted. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Marking volume 446a9d5f-86ca-40f0-a9f4-171e2b82abec as bootable. {{(pid=83214) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Copying metadata from image 44ed0884-61d3-4282-ab57-0ca406d243d3 to 446a9d5f-86ca-40f0-a9f4-171e2b82abec. {{(pid=83214) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Creating volume glance metadata for volume 446a9d5f-86ca-40f0-a9f4-171e2b82abec backed by image 44ed0884-61d3-4282-ab57-0ca406d243d3 with: {'image_id': '44ed0884-61d3-4282-ab57-0ca406d243d3', 'image_name': 'tempest-scenario-img--827230200', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83214) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954c600e-afb8-469d-a829-ef7abf010745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec', 'volume_size': 1, 'image_id': '44ed0884-61d3-4282-ab57-0ca406d243d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44ed0884-61d3-4282-ab57-0ca406d243d3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--827230200', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43640049cb6f4854b516d1e05c3bd316', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44ed0884-61d3-4282-ab57-0ca406d243d3', 'created_at': datetime.datetime(2025, 9, 17, 13, 41, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44ed0884-61d3-4282-ab57-0ca406d243d3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9065090>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57559857-19bc-480e-b77b-e27a9784a9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:42:12 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec (446a9d5f-86ca-40f0-a9f4-171e2b82abec): created successfully
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57559857-19bc-480e-b77b-e27a9784a9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:42:12 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Flow 'volume_create_manager' (c8b19804-bf0b-4432-b2fb-ee3fa0c3efe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:42:12 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-c404cabb-8757-4bf6-954c-c202d41148fd tempest-TestInstancesWithCinderVolumes-1611491097 None] Created volume successfully.
Sep 17 15:42:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:42:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:42:21 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[31674ced-7c65-4646-9384-ba93de03d6fa]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:42:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec" returned: 0 in 0.437s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:42:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec" returned: 1 in 0.367s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:42:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:42:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:42:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9664e7c4-560d-4e72-9453-3fdbd8e298e6', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:42:22 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:42:22 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-d8a89c7d-fabb-4cdf-89ce-eea4e372e4db req-ceb02715-b36e-4ffb-bfc2-f339f7ba4d94 tempest-TestInstancesWithCinderVolumes-1611491097 None] attachment_update completed successfully.
Sep 17 15:42:32 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=3 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:42:32 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=17,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=6 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:43:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:43:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:43:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:43:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:43:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:43:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:43:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:43:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.099s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:43:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:43:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-8c854dfd-6477-431e-bf10-0553b3f44009 req-b1af6d56-3f99-43a4-ba34-fa89688c24f2 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:43:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-8c854dfd-6477-431e-bf10-0553b3f44009 req-b1af6d56-3f99-43a4-ba34-fa89688c24f2 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:43:32 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d6ab3a-2559-4717-9828-79dfb302b661]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:43:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-8c854dfd-6477-431e-bf10-0553b3f44009 req-b1af6d56-3f99-43a4-ba34-fa89688c24f2 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:43:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-8c854dfd-6477-431e-bf10-0553b3f44009 req-b1af6d56-3f99-43a4-ba34-fa89688c24f2 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868" returned: 0 in 0.505s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:43:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-8c854dfd-6477-431e-bf10-0553b3f44009 req-b1af6d56-3f99-43a4-ba34-fa89688c24f2 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.592s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:43:33 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-8c854dfd-6477-431e-bf10-0553b3f44009 req-b1af6d56-3f99-43a4-ba34-fa89688c24f2 tempest-TestInstancesWithCinderVolumes-1611491097 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-3a27275f-3f3d-440a-ae29-4e84a7035868', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18546fa7-7f50-4a3c-be95-b45b8aca2144', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:43:33 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-8c854dfd-6477-431e-bf10-0553b3f44009 req-b1af6d56-3f99-43a4-ba34-fa89688c24f2 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:43:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-8c854dfd-6477-431e-bf10-0553b3f44009 req-b1af6d56-3f99-43a4-ba34-fa89688c24f2 tempest-TestInstancesWithCinderVolumes-1611491097 None] attachment_update completed successfully.
Sep 17 15:43:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-41b0346e-1b29-4541-9d9c-a674496d77b1 req-f1f8beff-790e-4aa8-9e42-80444462ea10 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:43:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-41b0346e-1b29-4541-9d9c-a674496d77b1 req-f1f8beff-790e-4aa8-9e42-80444462ea10 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:43:43 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2453ef00-227e-4db0-bf8f-868e0e995acf]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:43:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-41b0346e-1b29-4541-9d9c-a674496d77b1 req-f1f8beff-790e-4aa8-9e42-80444462ea10 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:43:43 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:43:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-41b0346e-1b29-4541-9d9c-a674496d77b1 req-f1f8beff-790e-4aa8-9e42-80444462ea10 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6" returned: 0 in 0.396s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:43:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-41b0346e-1b29-4541-9d9c-a674496d77b1 req-f1f8beff-790e-4aa8-9e42-80444462ea10 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.435s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:43:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-41b0346e-1b29-4541-9d9c-a674496d77b1 req-f1f8beff-790e-4aa8-9e42-80444462ea10 tempest-TestInstancesWithCinderVolumes-1611491097 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30239fe8-0369-43ab-af76-c80d18a1e774', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:43:43 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-41b0346e-1b29-4541-9d9c-a674496d77b1 req-f1f8beff-790e-4aa8-9e42-80444462ea10 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:43:44 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-41b0346e-1b29-4541-9d9c-a674496d77b1 req-f1f8beff-790e-4aa8-9e42-80444462ea10 tempest-TestInstancesWithCinderVolumes-1611491097 None] attachment_update completed successfully.
Sep 17 15:43:53 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:43:54 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:44:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:44:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:44:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:44:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:44:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:44:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:44:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:44:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.079s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:44:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:44:17 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-8634db6b-ae2b-45dc-b349-a155c85d7d3c req-e2ee5b4f-c364-49a4-a8c5-4804d208148d tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:44:17 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-8634db6b-ae2b-45dc-b349-a155c85d7d3c req-e2ee5b4f-c364-49a4-a8c5-4804d208148d tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:44:17 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-8634db6b-ae2b-45dc-b349-a155c85d7d3c req-e2ee5b4f-c364-49a4-a8c5-4804d208148d tempest-TestInstancesWithCinderVolumes-1611491097 None] Terminate volume connection completed successfully.
Sep 17 15:44:17 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-8634db6b-ae2b-45dc-b349-a155c85d7d3c req-e2ee5b4f-c364-49a4-a8c5-4804d208148d tempest-TestInstancesWithCinderVolumes-1611491097 None] Deleting attachment 18546fa7-7f50-4a3c-be95-b45b8aca2144. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:44:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "cinder-3a27275f-3f3d-440a-ae29-4e84a7035868-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:44:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-3a27275f-3f3d-440a-ae29-4e84a7035868-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:44:18 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:44:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "cinder-quobyte-3a27275f-3f3d-440a-ae29-4e84a7035868" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:44:18 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-quobyte-3a27275f-3f3d-440a-ae29-4e84a7035868" acquired by "delete_volume" :: waited 0.010s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:44:18 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[41251079-c557-453c-820e-237ff0a84462]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:44:18 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868" returned: 0 in 0.462s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3a27275f-3f3d-440a-ae29-4e84a7035868" returned: 0 in 0.137s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-quobyte-3a27275f-3f3d-440a-ae29-4e84a7035868" released by "delete_volume" :: held 0.760s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:44:19 devstack cinder-volume[83214]: WARNING cinder.quota [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391361729-1248908209 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391361729-1248908209, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:44:19 devstack cinder-volume[83214]: WARNING cinder.quota [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391361729-1248908209 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391361729-1248908209, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Created reservations ['204dfdd6-6a73-41e4-8aa6-31ea8cd5c59d', '9b114a33-e439-49bb-8aa2-8d3be89ac9ce', '6785dff7-f5b2-42d6-88cc-c077b4ceef00', 'bd9a2477-1559-4a49-8f47-831c7c18e19f'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.087s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:44:19 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:44:19 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Deleted volume successfully.
Sep 17 15:44:20 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-583cb38e-ce4f-460e-a861-9a3c2bb41598 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-3a27275f-3f3d-440a-ae29-4e84a7035868-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:44:29 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:44:29 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:44:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-7be51cc6-3981-481c-a7f2-07d048e1acce req-3bbe3f1d-7acc-4bbf-9ddb-01d76d50257e tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:44:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-7be51cc6-3981-481c-a7f2-07d048e1acce req-3bbe3f1d-7acc-4bbf-9ddb-01d76d50257e tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:44:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-7be51cc6-3981-481c-a7f2-07d048e1acce req-3bbe3f1d-7acc-4bbf-9ddb-01d76d50257e tempest-TestInstancesWithCinderVolumes-1611491097 None] Terminate volume connection completed successfully.
Sep 17 15:44:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-7be51cc6-3981-481c-a7f2-07d048e1acce req-3bbe3f1d-7acc-4bbf-9ddb-01d76d50257e tempest-TestInstancesWithCinderVolumes-1611491097 None] Deleting attachment 30239fe8-0369-43ab-af76-c80d18a1e774. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "cinder-274cde1a-2e19-4d3b-a2c6-9e77874edcc6-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-274cde1a-2e19-4d3b-a2c6-9e77874edcc6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:44:48 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "cinder-quobyte-274cde1a-2e19-4d3b-a2c6-9e77874edcc6" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-quobyte-274cde1a-2e19-4d3b-a2c6-9e77874edcc6" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c164a35-176c-4f22-90e7-789746ad2982]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6" returned: 0 in 0.479s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-274cde1a-2e19-4d3b-a2c6-9e77874edcc6" returned: 0 in 0.096s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:44:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-quobyte-274cde1a-2e19-4d3b-a2c6-9e77874edcc6" released by "delete_volume" :: held 0.746s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:44:49 devstack cinder-volume[83214]: WARNING cinder.quota [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1296062699-144690699 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1296062699-144690699, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:44:49 devstack cinder-volume[83214]: WARNING cinder.quota [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1296062699-144690699 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1296062699-144690699, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Created reservations ['5a238fcc-5572-4f94-9783-b1fe90bee1c5', 'e4b7e62a-53f4-4ed4-aac5-7b4fa77047e5', 'ab6cbebb-d372-49e1-8c93-117416579e4c', 'd7fe2413-769b-4d2b-8cfd-e9c045111181'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.095s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:44:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Deleted volume successfully.
Sep 17 15:44:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-0b0ce2d5-0d95-4fbf-9f8f-57b171320a6c tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-274cde1a-2e19-4d3b-a2c6-9e77874edcc6-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:44:56 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-dbf87de3-8425-4c95-b234-515275104174 req-b71ea1ad-54ea-4f16-998c-5ae82a9b4415 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:44:56 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-dbf87de3-8425-4c95-b234-515275104174 req-b71ea1ad-54ea-4f16-998c-5ae82a9b4415 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:44:56 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-dbf87de3-8425-4c95-b234-515275104174 req-b71ea1ad-54ea-4f16-998c-5ae82a9b4415 tempest-TestInstancesWithCinderVolumes-1611491097 None] Terminate volume connection completed successfully.
Sep 17 15:44:56 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-dbf87de3-8425-4c95-b234-515275104174 req-b71ea1ad-54ea-4f16-998c-5ae82a9b4415 tempest-TestInstancesWithCinderVolumes-1611491097 None] Deleting attachment 9664e7c4-560d-4e72-9453-3fdbd8e298e6. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:44:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "cinder-446a9d5f-86ca-40f0-a9f4-171e2b82abec-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:44:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-446a9d5f-86ca-40f0-a9f4-171e2b82abec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:44:59 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:44:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "cinder-quobyte-446a9d5f-86ca-40f0-a9f4-171e2b82abec" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:44:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-quobyte-446a9d5f-86ca-40f0-a9f4-171e2b82abec" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:44:59 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7a949e-75eb-4f5c-958a-d825abfd372b]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:44:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:44:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec" returned: 0 in 0.391s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:44:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec" returned: 1 in 0.349s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-446a9d5f-86ca-40f0-a9f4-171e2b82abec" returned: 0 in 0.106s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-quobyte-446a9d5f-86ca-40f0-a9f4-171e2b82abec" released by "delete_volume" :: held 1.196s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:45:00 devstack cinder-volume[83214]: WARNING cinder.quota [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-664236636-872029924 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-664236636-872029924, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:45:00 devstack cinder-volume[83214]: WARNING cinder.quota [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-664236636-872029924 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-664236636-872029924, it is now deprecated. Please use the default quota class for default quota.
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Created reservations ['afba2f2f-2b2c-49d2-8643-db5f6c500f17', 'ed66158f-ac8a-44ad-8ab8-3cc9cbd5e7b0', '60eb05e8-2654-403d-b4c4-b5f87912f83c', '0a321ae3-000d-4974-b963-d58528672d42'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:45:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:45:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.161s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:45:01 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:45:01 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Deleted volume successfully.
Sep 17 15:45:01 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-8aad33ac-3aee-42c5-bb82-559a40d45273 tempest-TestInstancesWithCinderVolumes-1611491097 None] Lock "cinder-446a9d5f-86ca-40f0-a9f4-171e2b82abec-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:45:10 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=9,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:45:11 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:45:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:45:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:45:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:45:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:45:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:45:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:45:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:45:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.118s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:45:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:46:00 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:46:00 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:46:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Flow 'volume_create_manager' (7bc5d15b-09af-4907-81b2-b024ba987a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:46:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e80cfb1-acde-4b75-a04a-ef8aaa5de455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:46:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e80cfb1-acde-4b75-a04a-ef8aaa5de455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-552375508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f65f30-2e00-437a-8a74-12a03050c52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a56324b7b2043b09fb04d2ff098648d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:46:01Z,use_quota=True,user_id='47a1f7fb5a7b4621bc5afa245820ae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:46:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fa7b84-5099-488d-99cf-c72ac54a1f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:46:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fa7b84-5099-488d-99cf-c72ac54a1f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:46:00 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8243b17b-45f8-4b37-8659-b8e9f707ca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8243b17b-45f8-4b37-8659-b8e9f707ca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f65f30-2e00-437a-8a74-12a03050c52b', 'volume_name': 'volume-64f65f30-2e00-437a-8a74-12a03050c52b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d3942f-e4d9-42ec-b580-df73b2a8608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d3942f-e4d9-42ec-b580-df73b2a8608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2303ca-7eda-41ef-a8fc-b45a2c73dad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:46:01 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Volume 64f65f30-2e00-437a-8a74-12a03050c52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f65f30-2e00-437a-8a74-12a03050c52b', 'volume_size': 1}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-552375508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f65f30-2e00-437a-8a74-12a03050c52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a56324b7b2043b09fb04d2ff098648d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:46:01Z,use_quota=True,user_id='47a1f7fb5a7b4621bc5afa245820ae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Creating volume 64f65f30-2e00-437a-8a74-12a03050c52b {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:46:01 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:46:01 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=140, name=volume-64f65f30-2e00-437a-8a74-12a03050c52b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b 1073741824" returned: 0 in 0.480s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b" returned: 0 in 0.304s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] <== create_volume: return (891ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:46:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:46:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2303ca-7eda-41ef-a8fc-b45a2c73dad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f65f30-2e00-437a-8a74-12a03050c52b', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:46:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8d57ef-05cf-41fc-acd1-fb7fae48d760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:46:02 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Volume volume-64f65f30-2e00-437a-8a74-12a03050c52b (64f65f30-2e00-437a-8a74-12a03050c52b): created successfully
Sep 17 15:46:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8d57ef-05cf-41fc-acd1-fb7fae48d760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:46:02 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Flow 'volume_create_manager' (7bc5d15b-09af-4907-81b2-b024ba987a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:46:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-eb3d5ff3-9d19-44d0-b080-f59da9cd55d2 tempest-TestMinimumBasicScenario-1693001998 None] Created volume successfully.
Sep 17 15:46:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-4ebd8e7f-3167-41ae-8245-94fe77a2a5b8 req-c39b2725-3b89-4b1b-a105-159bed7746a4 tempest-TestMinimumBasicScenario-1693001998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:46:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-4ebd8e7f-3167-41ae-8245-94fe77a2a5b8 req-c39b2725-3b89-4b1b-a105-159bed7746a4 tempest-TestMinimumBasicScenario-1693001998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:46:07 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f76b8a-f49c-4d5e-b1e5-48b26a55465b]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:46:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-4ebd8e7f-3167-41ae-8245-94fe77a2a5b8 req-c39b2725-3b89-4b1b-a105-159bed7746a4 tempest-TestMinimumBasicScenario-1693001998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:46:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-4ebd8e7f-3167-41ae-8245-94fe77a2a5b8 req-c39b2725-3b89-4b1b-a105-159bed7746a4 tempest-TestMinimumBasicScenario-1693001998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b" returned: 0 in 0.516s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:46:07 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-4ebd8e7f-3167-41ae-8245-94fe77a2a5b8 req-c39b2725-3b89-4b1b-a105-159bed7746a4 tempest-TestMinimumBasicScenario-1693001998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.562s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:46:07 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-4ebd8e7f-3167-41ae-8245-94fe77a2a5b8 req-c39b2725-3b89-4b1b-a105-159bed7746a4 tempest-TestMinimumBasicScenario-1693001998 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-64f65f30-2e00-437a-8a74-12a03050c52b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8023ae9f-c040-4bdc-81e8-d5f19bce49f0', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:46:07 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-4ebd8e7f-3167-41ae-8245-94fe77a2a5b8 req-c39b2725-3b89-4b1b-a105-159bed7746a4 tempest-TestMinimumBasicScenario-1693001998 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:46:08 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-4ebd8e7f-3167-41ae-8245-94fe77a2a5b8 req-c39b2725-3b89-4b1b-a105-159bed7746a4 tempest-TestMinimumBasicScenario-1693001998 None] attachment_update completed successfully.
Sep 17 15:46:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:46:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:46:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:46:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:46:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:46:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:46:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:46:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.126s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:46:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:46:18 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:46:18 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:47:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:47:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:47:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:47:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:47:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:47:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:47:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:47:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.108s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:47:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:48:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:48:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:48:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:48:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:48:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:48:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:48:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:48:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.078s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:48:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:48:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:48:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:48:40 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-92ccecc3-440e-4e7f-895b-ec568940a0ac req-83bc6083-ea0a-48ee-a219-aa0d6595e16b tempest-TestMinimumBasicScenario-1693001998 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:48:40 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-92ccecc3-440e-4e7f-895b-ec568940a0ac req-83bc6083-ea0a-48ee-a219-aa0d6595e16b tempest-TestMinimumBasicScenario-1693001998 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:48:40 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-92ccecc3-440e-4e7f-895b-ec568940a0ac req-83bc6083-ea0a-48ee-a219-aa0d6595e16b tempest-TestMinimumBasicScenario-1693001998 None] Terminate volume connection completed successfully.
Sep 17 15:48:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-92ccecc3-440e-4e7f-895b-ec568940a0ac req-83bc6083-ea0a-48ee-a219-aa0d6595e16b tempest-TestMinimumBasicScenario-1693001998 None] Deleting attachment 8023ae9f-c040-4bdc-81e8-d5f19bce49f0. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:48:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Acquiring lock "cinder-64f65f30-2e00-437a-8a74-12a03050c52b-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:48:42 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Lock "cinder-64f65f30-2e00-437a-8a74-12a03050c52b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:48:42 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:48:42 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Acquiring lock "cinder-quobyte-64f65f30-2e00-437a-8a74-12a03050c52b" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:48:42 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Lock "cinder-quobyte-64f65f30-2e00-437a-8a74-12a03050c52b" acquired by "delete_volume" :: waited 0.016s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:48:42 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4949cd5-c47d-4484-b97b-72d1049621ec]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:48:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:48:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b" returned: 0 in 0.422s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:48:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:48:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-64f65f30-2e00-437a-8a74-12a03050c52b" returned: 0 in 0.090s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:48:42 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Lock "cinder-quobyte-64f65f30-2e00-437a-8a74-12a03050c52b" released by "delete_volume" :: held 0.667s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Created reservations ['12462464-b13f-4c9c-9acc-a565b8d4e300', '4628ec3b-9a17-4c7e-810b-caee372fa9f3', 'f55530a9-b740-4db6-b8d0-8031fed5ea86', '2030d53f-bf38-4970-ad57-c57ea0d01265'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.079s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:48:43 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Deleted volume successfully.
Sep 17 15:48:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1968ea77-4d9d-4a6f-bae2-c1618c66a040 tempest-TestMinimumBasicScenario-1693001998 None] Lock "cinder-64f65f30-2e00-437a-8a74-12a03050c52b-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:48:53 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:48:53 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:49:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:49:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:49:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:49:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:49:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:49:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:49:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.108s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:49:30 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Flow 'volume_create_manager' (8c236b38-5d2c-42b0-aa59-a5e11318ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a76fe0-4ded-4604-8dd3-c4c618d529c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a76fe0-4ded-4604-8dd3-c4c618d529c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1119458901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bf4633-4703-4eae-b83a-cfd96ae7e126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc79f060f3954c7c95d9eabaf02735ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:49:30Z,use_quota=True,user_id='9a09a1cd9037498cb10742a3d7a2e4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd29b55-fdfc-4e82-b9d5-97cf7d652422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd29b55-fdfc-4e82-b9d5-97cf7d652422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b14f8-1296-48d6-a2ce-31fda8211f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.image.glance [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Creating Keystone auth plugin from conf {{(pid=83214) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b14f8-1296-48d6-a2ce-31fda8211f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77bf4633-4703-4eae-b83a-cfd96ae7e126', 'volume_name': 'volume-77bf4633-4703-4eae-b83a-cfd96ae7e126', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9182440>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9e1e3f-2d4a-42bc-a523-5f3fcbda55c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9e1e3f-2d4a-42bc-a523-5f3fcbda55c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1001bfa-9fe0-432e-a31e-15d6407a2e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:49:30 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Volume 77bf4633-4703-4eae-b83a-cfd96ae7e126: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77bf4633-4703-4eae-b83a-cfd96ae7e126', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9182440>}
Sep 17 15:49:30 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Cloning 77bf4633-4703-4eae-b83a-cfd96ae7e126 from image 1365088a-6d64-46d1-8e72-c667035bafb6  at location (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]). {{(pid=83214) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 15:49:31 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 15:49:31 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 15:49:31 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd545d5-eaa7-44aa-b265-387ea7384707]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:49:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:31 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD
Sep 17 15:49:31 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:49:33 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Sep 17 15:49:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD" returned: 0 in 1.914s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:33 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Temporary image 1365088a-6d64-46d1-8e72-c667035bafb6 is fetched for user 9a09a1cd9037498cb10742a3d7a2e4d7. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 15:49:33 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da57a76-c3d0-4f41-820f-fc2cecdb1595]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:49:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:33 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD
Sep 17 15:49:33 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:49:35 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD" returned: 0 in 1.870s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1119458901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bf4633-4703-4eae-b83a-cfd96ae7e126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc79f060f3954c7c95d9eabaf02735ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:49:30Z,use_quota=True,user_id='9a09a1cd9037498cb10742a3d7a2e4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Creating volume 77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:49:35 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:35 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=141, name=volume-77bf4633-4703-4eae-b83a-cfd96ae7e126, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 1073741824" returned: 0 in 0.300s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 0 in 0.081s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] <== create_volume: return (466ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:49:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.503s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:49:36 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Attempting download of 1365088a-6d64-46d1-8e72-c667035bafb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}])) to volume 77bf4633-4703-4eae-b83a-cfd96ae7e126. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 15:49:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0793b00-79c6-4ca7-aebd-90dd1f6e9a8f]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:49:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_tgtzrqyp {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_tgtzrqyp" returned: 0 in 0.327s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_tgtzrqyp {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_tgtzrqyp" returned: 1 in 0.324s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1365088a-6d64-46d1-8e72-c667035bafb6_tgtzrqyp' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:49:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e3a46e-29c4-426c-8995-6d0dd6f26eb2]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:49:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:37 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] 1365088a-6d64-46d1-8e72-c667035bafb6 was qcow2, converting to raw {{(pid=83214) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 15:49:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:37 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=141, name=volume-77bf4633-4703-4eae-b83a-cfd96ae7e126, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:49:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 0 in 0.971s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:38 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1365088a-6d64-46d1-8e72-c667035bafb6_pjfof0t6devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:49:38 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Converted 112.00 MB image at 112.00 MB/s
Sep 17 15:49:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 1G" returned: 0 in 0.146s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:38 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[986ae2b1-b5d3-405b-a572-93bf510524bb]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:49:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 0 in 0.347s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 1 in 0.338s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Downloaded image 1365088a-6d64-46d1-8e72-c667035bafb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}])) to volume 77bf4633-4703-4eae-b83a-cfd96ae7e126 successfully. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Temporary image 1365088a-6d64-46d1-8e72-c667035bafb6 for user 9a09a1cd9037498cb10742a3d7a2e4d7 is deleted. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Marking volume 77bf4633-4703-4eae-b83a-cfd96ae7e126 as bootable. {{(pid=83214) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Copying metadata from image 1365088a-6d64-46d1-8e72-c667035bafb6 to 77bf4633-4703-4eae-b83a-cfd96ae7e126. {{(pid=83214) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Creating volume glance metadata for volume 77bf4633-4703-4eae-b83a-cfd96ae7e126 backed by image 1365088a-6d64-46d1-8e72-c667035bafb6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83214) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1001bfa-9fe0-432e-a31e-15d6407a2e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77bf4633-4703-4eae-b83a-cfd96ae7e126', 'volume_size': 1, 'image_id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1365088a-6d64-46d1-8e72-c667035bafb6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c40e67d2fcd642e5aa6dcc3e2a5edc27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1365088a-6d64-46d1-8e72-c667035bafb6', 'created_at': datetime.datetime(2025, 9, 17, 13, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 0, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1365088a-6d64-46d1-8e72-c667035bafb6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9182440>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2786f025-073c-4adb-b6b2-e45387a36d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:49:39 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Volume volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 (77bf4633-4703-4eae-b83a-cfd96ae7e126): created successfully
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2786f025-073c-4adb-b6b2-e45387a36d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:49:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Flow 'volume_create_manager' (8c236b38-5d2c-42b0-aa59-a5e11318ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:49:39 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-39be2fe6-315f-4320-a664-9f3c6adc4f9e tempest-TestShelveInstance-262612087 None] Created volume successfully.
Sep 17 15:49:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:49:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:49:48 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2baad3-a9b8-452e-8775-f5014f993875]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:49:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 0 in 0.431s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:49:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 1 in 0.356s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:49:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:49:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.895s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:49:50 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-77bf4633-4703-4eae-b83a-cfd96ae7e126', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69410ac8-1ca9-4bb9-aca2-5e2ebdeb4186', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:49:50 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:49:50 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-4e8fe2e8-8b4c-4062-bd9e-24fd5951bab0 req-48510316-3ede-4c92-9c22-a6349e93b6d6 tempest-TestShelveInstance-262612087 None] attachment_update completed successfully.
Sep 17 15:50:00 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=6,cinder:SELECT=14,cinder:INSERT=7 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:50:00 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:50:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:50:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:50:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:50:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:50:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:50:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:50:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:50:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.085s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:50:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:50:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:50:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:51:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:51:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:51:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:51:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:51:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:51:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:51:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:51:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.126s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:51:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:51:17 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3a3a8c5f-1830-4903-864b-c7045569e08f req-883046f3-bfe5-41c6-bdfa-ab788b65bb80 tempest-TestShelveInstance-262612087 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:51:18 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-3a3a8c5f-1830-4903-864b-c7045569e08f req-883046f3-bfe5-41c6-bdfa-ab788b65bb80 tempest-TestShelveInstance-262612087 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:51:18 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-3a3a8c5f-1830-4903-864b-c7045569e08f req-883046f3-bfe5-41c6-bdfa-ab788b65bb80 tempest-TestShelveInstance-262612087 None] Terminate volume connection completed successfully.
Sep 17 15:51:18 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-3a3a8c5f-1830-4903-864b-c7045569e08f req-883046f3-bfe5-41c6-bdfa-ab788b65bb80 tempest-TestShelveInstance-262612087 None] Deleting attachment 69410ac8-1ca9-4bb9-aca2-5e2ebdeb4186. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:51:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:51:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:51:23 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e2170e-9f80-48d8-958b-a0d59ada4f0b]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:51:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:51:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 0 in 0.380s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:51:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:51:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 1 in 0.355s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:51:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:51:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:51:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11', 'name': 'volume-77bf4633-4703-4eae-b83a-cfd96ae7e126', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43777c1d-88b2-441e-8e90-e50ce55cc351', 'enforce_multipath': True} {{(pid=83214) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 15:51:24 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:51:24 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-095a21ac-7514-4391-8a9c-3da32dc7096b req-18a82de9-b08c-46aa-a03a-ff7c3bf42eb3 tempest-TestShelveInstance-262612087 None] attachment_update completed successfully.
Sep 17 15:51:34 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:51:34 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:52:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:52:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:52:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:52:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:52:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:52:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:52:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:52:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.084s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:52:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:52:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:52:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:52:54 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-96379f99-5c47-4543-a042-1ded50f888ba tempest-TestShelveInstance-262612087 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:52:54 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-96379f99-5c47-4543-a042-1ded50f888ba tempest-TestShelveInstance-262612087 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:52:54 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-96379f99-5c47-4543-a042-1ded50f888ba tempest-TestShelveInstance-262612087 None] Terminate volume connection completed successfully.
Sep 17 15:52:54 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-96379f99-5c47-4543-a042-1ded50f888ba tempest-TestShelveInstance-262612087 None] Deleting attachment 43777c1d-88b2-441e-8e90-e50ce55cc351. {{(pid=83214) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 15:52:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Acquiring lock "cinder-77bf4633-4703-4eae-b83a-cfd96ae7e126-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:52:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Lock "cinder-77bf4633-4703-4eae-b83a-cfd96ae7e126-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:52:55 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:52:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Acquiring lock "cinder-quobyte-77bf4633-4703-4eae-b83a-cfd96ae7e126" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:52:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Lock "cinder-quobyte-77bf4633-4703-4eae-b83a-cfd96ae7e126" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:52:55 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b520d202-67c8-4697-b97d-6d3eec83e948]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:52:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:52:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 0 in 0.382s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:52:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:52:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 1 in 0.356s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:52:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:52:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:52:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-77bf4633-4703-4eae-b83a-cfd96ae7e126" returned: 0 in 0.154s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:52:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Lock "cinder-quobyte-77bf4633-4703-4eae-b83a-cfd96ae7e126" released by "delete_volume" :: held 1.149s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:52:56 devstack cinder-volume[83214]: DEBUG cinder.quota [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Created reservations ['d7263fe2-c3fd-4164-8d8d-7536e862caf3', '890aa10c-9414-4430-806f-9137344b9db7', '5e532129-8811-4ce5-aa3e-c023f198268a', 'c70cc9da-400b-4073-8428-28f24cec1680'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:52:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:52:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:52:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:52:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:52:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:52:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:52:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.091s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:52:57 devstack cinder-volume[83214]: DEBUG cinder.manager [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:52:57 devstack cinder-volume[83214]: INFO cinder.volume.manager [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Deleted volume successfully.
Sep 17 15:52:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [req-64ba35c1-4b09-445e-86de-583aeaab0c1a req-548a6bc4-5af5-457c-aa21-87f46ab3e7cc tempest-TestShelveInstance-262612087 None] Lock "cinder-77bf4633-4703-4eae-b83a-cfd96ae7e126-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:53:06 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:53:07 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:53:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:53:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:53:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:53:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:53:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:53:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:53:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.141s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:53:34 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Flow 'volume_create_manager' (a6736e67-e13d-4313-a6b0-2c641545c640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1323323c-b878-43e0-9c4a-1efcc50d4bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1323323c-b878-43e0-9c4a-1efcc50d4bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-606302578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b55700c-e74e-4192-9173-2b91c26f8a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e72f6df64649d5a29d59bdd4a15df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:53:34Z,use_quota=True,user_id='0f230920d9b34d0680cb79c9dbee637c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434aa643-8d49-4edd-aebf-8d625be55d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434aa643-8d49-4edd-aebf-8d625be55d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9facca1-68e7-482f-b446-bef9260389c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9facca1-68e7-482f-b446-bef9260389c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b55700c-e74e-4192-9173-2b91c26f8a5d', 'volume_name': 'volume-5b55700c-e74e-4192-9173-2b91c26f8a5d', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7eb96f-38f4-44fb-a292-234ff0fba797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7eb96f-38f4-44fb-a292-234ff0fba797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873fee0d-e5c1-4c22-9620-7498f0a9c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:34 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Volume 5b55700c-e74e-4192-9173-2b91c26f8a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b55700c-e74e-4192-9173-2b91c26f8a5d', 'volume_size': 1}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-606302578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b55700c-e74e-4192-9173-2b91c26f8a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e72f6df64649d5a29d59bdd4a15df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:53:34Z,use_quota=True,user_id='0f230920d9b34d0680cb79c9dbee637c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Creating volume 5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:53:34 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:34 devstack quobyte-client[83236]: System call of process 101041 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:53:34 devstack quobyte-client[83236]: System call of process 101041 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:53:34 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=142, name=volume-5b55700c-e74e-4192-9173-2b91c26f8a5d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d 1073741824" returned: 0 in 0.396s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d" returned: 0 in 0.126s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] <== create_volume: return (594ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:53:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.609s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:53:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873fee0d-e5c1-4c22-9620-7498f0a9c784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b55700c-e74e-4192-9173-2b91c26f8a5d', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ffc059-f21b-44d7-8c88-eddff0e18ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:35 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Volume volume-5b55700c-e74e-4192-9173-2b91c26f8a5d (5b55700c-e74e-4192-9173-2b91c26f8a5d): created successfully
Sep 17 15:53:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ffc059-f21b-44d7-8c88-eddff0e18ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Flow 'volume_create_manager' (a6736e67-e13d-4313-a6b0-2c641545c640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:53:35 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-641729ba-65ee-4230-a131-5e05b2534263 tempest-SnapshotDependencyTests-639636165 None] Created volume successfully.
Sep 17 15:53:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:53:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:53:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:53:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Creating offline snapshot 3c31671e-11e7-4643-a351-089ce48959c8 of volume 5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:53:36 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5184f911-2195-4945-8d71-c141d2aa2290]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:53:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d" returned: 0 in 0.372s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:37 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=143, name=volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 1G" returned: 0 in 0.217s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5b55700c-e74e-4192-9173-2b91c26f8a5d -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] CMD "qemu-img rebase -u -b volume-5b55700c-e74e-4192-9173-2b91c26f8a5d -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8" returned: 0 in 0.120s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8" returned: 0 in 0.093s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8" returned: 0 in 0.096s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.info" returned: 0 in 0.086s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.info" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.379s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:53:38 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-4337fb80-0a3d-44c5-a9c1-208872782ff8 tempest-SnapshotDependencyTests-639636165 None] Create snapshot completed successfully
Sep 17 15:53:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Flow 'volume_create_manager' (2f168272-849b-4594-bba1-c207b3f59781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8532486-63ef-4934-94b0-dadc4fc34d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8532486-63ef-4934-94b0-dadc4fc34d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a870241-fabc-4408-b27a-0aa0165b023f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e72f6df64649d5a29d59bdd4a15df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3c31671e-11e7-4643-a351-089ce48959c8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:53:39Z,use_quota=True,user_id='0f230920d9b34d0680cb79c9dbee637c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf05851c-9bef-4337-9aec-210676a20647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf05851c-9bef-4337-9aec-210676a20647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f59fe6c-7694-4b6f-b1b0-2de5c78cc404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f59fe6c-7694-4b6f-b1b0-2de5c78cc404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a870241-fabc-4408-b27a-0aa0165b023f', 'volume_name': 'volume-7a870241-fabc-4408-b27a-0aa0165b023f', 'volume_size': 1, 'snapshot_id': '3c31671e-11e7-4643-a351-089ce48959c8'}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351e0abd-3ef8-49b6-8cab-b4660d3de10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351e0abd-3ef8-49b6-8cab-b4660d3de10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db32628-dc64-43d8-b5f9-cb3c50219eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:39 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Volume 7a870241-fabc-4408-b27a-0aa0165b023f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a870241-fabc-4408-b27a-0aa0165b023f', 'volume_size': 1, 'snapshot_id': '3c31671e-11e7-4643-a351-089ce48959c8'}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "cinder-quobyte-3c31671e-11e7-4643-a351-089ce48959c8-7a870241-fabc-4408-b27a-0aa0165b023f" by "_create_volume_from_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-3c31671e-11e7-4643-a351-089ce48959c8-7a870241-fabc-4408-b27a-0aa0165b023f" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Creating volume 7a870241-fabc-4408-b27a-0aa0165b023f from snapshot 3c31671e-11e7-4643-a351-089ce48959c8 {{(pid=83214) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "cinder-quobyte-7a870241-fabc-4408-b27a-0aa0165b023f" by "_copy_volume_from_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-7a870241-fabc-4408-b27a-0aa0165b023f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] snapshot: 3c31671e-11e7-4643-a351-089ce48959c8, volume: 7a870241-fabc-4408-b27a-0aa0165b023f,  {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e30e209-e1ee-4b51-8cc3-44a5dec2e5c5]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:53:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8" returned: 0 in 0.373s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b55700c-e74e-4192-9173-2b91c26f8a5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:53:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 15:53:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Creating direct copy from snapshot {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 15:53:40 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0691597-e9ad-4db2-9e6b-972120e1bad3]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:53:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d" returned: 0 in 0.377s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:40 devstack cinder-volume[83214]: DEBUG cinder.utils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f not found in is_blk_device check {{(pid=83214) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 15:53:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:40 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=145, name=volume-7a870241-fabc-4408-b27a-0aa0165b023f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f" returned: 0 in 4.473s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[babb5aa4-125f-4c29-84c8-2681cc767eb8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d" returned: 0 in 0.549s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Image conversion details: src /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:53:45 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Converted 1024.00 MB image at 227.62 MB/s
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-7a870241-fabc-4408-b27a-0aa0165b023f" released by "_copy_volume_from_snapshot" :: held 6.215s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-3c31671e-11e7-4643-a351-089ce48959c8-7a870241-fabc-4408-b27a-0aa0165b023f" released by "_create_volume_from_snapshot" :: held 6.250s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:53:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.270s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:53:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db32628-dc64-43d8-b5f9-cb3c50219eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a870241-fabc-4408-b27a-0aa0165b023f', 'volume_size': 1, 'snapshot_id': '3c31671e-11e7-4643-a351-089ce48959c8'}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8a8a26-475c-46c9-a5f7-aa6f363ff713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:53:46 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Volume volume-7a870241-fabc-4408-b27a-0aa0165b023f (7a870241-fabc-4408-b27a-0aa0165b023f): created successfully
Sep 17 15:53:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8a8a26-475c-46c9-a5f7-aa6f363ff713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:53:46 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Flow 'volume_create_manager' (2f168272-849b-4594-bba1-c207b3f59781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:53:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-5c411d5e-848e-49f2-b46b-db66da9dec6f tempest-SnapshotDependencyTests-639636165 None] Created volume successfully.
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "cinder-3c31671e-11e7-4643-a351-089ce48959c8-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-3c31671e-11e7-4643-a351-089ce48959c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:53:47 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "cinder-quobyte-5b55700c-e74e-4192-9173-2b91c26f8a5d" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-5b55700c-e74e-4192-9173-2b91c26f8a5d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "cinder-quobyte-3c31671e-11e7-4643-a351-089ce48959c8" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-3c31671e-11e7-4643-a351-089ce48959c8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Deleting offline snapshot 3c31671e-11e7-4643-a351-089ce48959c8 of volume 5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] snapshot_file for this snap is: volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[833bee42-3963-42d5-b9dd-7b8df7bb9406]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8" returned: 0 in 0.367s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b55700c-e74e-4192-9173-2b91c26f8a5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85c3d4a-f354-45bb-8835-927d820aab9d]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:53:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d" returned: 0 in 0.383s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8" returned: 0 in 0.225s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d.3c31671e-11e7-4643-a351-089ce48959c8" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-3c31671e-11e7-4643-a351-089ce48959c8" released by "_delete_snapshot" :: held 1.317s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:53:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-5b55700c-e74e-4192-9173-2b91c26f8a5d" released by "delete_snapshot" :: held 1.339s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:53:49 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Created reservations ['56b53f97-1167-4a09-820c-2d059fa03b39', '201969ed-4986-47fa-9dd8-f54bce51b62a', 'f0678b34-6d49-4ed0-ba6b-3c1e093eb8fc', 'ed40d2ed-a64a-4c06-80f0-5b52753271a5'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:53:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Delete snapshot completed successfully.
Sep 17 15:53:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2544e75b-cd81-4108-ad2a-29835430e784 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-3c31671e-11e7-4643-a351-089ce48959c8-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:53:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "cinder-5b55700c-e74e-4192-9173-2b91c26f8a5d-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:53:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-5b55700c-e74e-4192-9173-2b91c26f8a5d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:53:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:53:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "cinder-quobyte-5b55700c-e74e-4192-9173-2b91c26f8a5d" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:53:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-5b55700c-e74e-4192-9173-2b91c26f8a5d" acquired by "delete_volume" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:53:49 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[69407c4a-cb54-4e50-bc40-0a3d27447599]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:53:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d" returned: 0 in 0.368s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-5b55700c-e74e-4192-9173-2b91c26f8a5d" returned: 0 in 0.117s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-5b55700c-e74e-4192-9173-2b91c26f8a5d" released by "delete_volume" :: held 0.638s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Created reservations ['ab2b73b0-f2b0-425b-b462-714beee38866', '7e90ed0f-fb4f-49cb-9786-400e7c10595a', 'da08457b-6563-422a-94a5-3ffff1cbd6c2', '1491c9bf-9676-4dfe-965f-d5ccc03093ab'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "cinder-7a870241-fabc-4408-b27a-0aa0165b023f-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.288s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:50 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:53:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Deleted volume successfully.
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-7a870241-fabc-4408-b27a-0aa0165b023f-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-2063f2cc-6673-4a10-991a-5516f081be11 tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-5b55700c-e74e-4192-9173-2b91c26f8a5d-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:53:51 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "cinder-quobyte-7a870241-fabc-4408-b27a-0aa0165b023f" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-7a870241-fabc-4408-b27a-0aa0165b023f" acquired by "delete_volume" :: waited 0.012s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae5f1bc-8702-4c03-99f8-e7446f0cdd65]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f" returned: 0 in 0.410s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-7a870241-fabc-4408-b27a-0aa0165b023f" returned: 0 in 0.084s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-quobyte-7a870241-fabc-4408-b27a-0aa0165b023f" released by "delete_volume" :: held 0.669s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Created reservations ['9633ebba-97f5-4e5b-935c-fad6a25adc3b', '9778cb4a-8bfb-440d-aa4e-067ee09acc00', '7245a5fe-9a3a-425c-b296-4d5d3892883f', '8bda805e-4f77-4840-818c-3d187a2bb7fd'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.082s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:53:52 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Deleted volume successfully.
Sep 17 15:53:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b6ec8d12-d712-41c5-926a-f1246faf343e tempest-SnapshotDependencyTests-639636165 None] Lock "cinder-7a870241-fabc-4408-b27a-0aa0165b023f-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:02 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=10 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:54:02 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=29,cinder:SELECT=17,cinder:DELETE=3,cinder:INSERT=2 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:54:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:54:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.170s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:54:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:54:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=1 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:54:22 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (81475685-01d8-4e64-b7db-16537dc80cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81bbe12-cb96-4eaf-82aa-985f4bc921ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:22 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (2ddb8750-5fd0-4898-aab0-e226a1df2bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ffa058-c08f-4b43-a9a3-d726395856be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ffa058-c08f-4b43-a9a3-d726395856be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-529736203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af10867-d211-445c-9fdd-9824eb4064f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:23Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0804fb78-5c60-4255-9c2f-055455bfca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0804fb78-5c60-4255-9c2f-055455bfca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51a2fa1-24ce-4181-ab19-95cc423fb105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51a2fa1-24ce-4181-ab19-95cc423fb105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af10867-d211-445c-9fdd-9824eb4064f8', 'volume_name': 'volume-0af10867-d211-445c-9fdd-9824eb4064f8', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5583b8bf-9f3b-486a-b347-fe240af4033f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5583b8bf-9f3b-486a-b347-fe240af4033f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e0134b-d452-4d11-8aa0-16f6eb86af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:22 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume 0af10867-d211-445c-9fdd-9824eb4064f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af10867-d211-445c-9fdd-9824eb4064f8', 'volume_size': 1}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-529736203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af10867-d211-445c-9fdd-9824eb4064f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:23Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Creating volume 0af10867-d211-445c-9fdd-9824eb4064f8 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:22 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:23 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:23 devstack quobyte-client[83236]: System call of process 101169 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:54:23 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=146, name=volume-0af10867-d211-445c-9fdd-9824eb4064f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81bbe12-cb96-4eaf-82aa-985f4bc921ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1310197031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df12ecb7-5739-4b9d-9d44-485a6e4547f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:22Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3a6194-43f4-4623-aa96-d25b10776795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3a6194-43f4-4623-aa96-d25b10776795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edba21ba-4135-45b5-b9bc-47112638cd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edba21ba-4135-45b5-b9bc-47112638cd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df12ecb7-5739-4b9d-9d44-485a6e4547f5', 'volume_name': 'volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04aed14e-cfa3-40b3-8c37-66a08c9e67d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04aed14e-cfa3-40b3-8c37-66a08c9e67d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f52518-34ff-4961-a456-d5aa2476bf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:23 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Volume df12ecb7-5739-4b9d-9d44-485a6e4547f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5', 'volume_size': 1}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 1073741824" returned: 0 in 0.784s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:24 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (1dc03a84-8669-4fda-873f-8e2f07e7dbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf564c5-c09e-4ba1-905e-c9f4795ab9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf564c5-c09e-4ba1-905e-c9f4795ab9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306235330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d832510-7bfb-4545-9a19-0643c5cab93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:23Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d9652c-640a-4ab1-9f30-3f78c7e31296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d9652c-640a-4ab1-9f30-3f78c7e31296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0e9856-72b2-4360-a0b1-8b21ca8c3af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0e9856-72b2-4360-a0b1-8b21ca8c3af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d832510-7bfb-4545-9a19-0643c5cab93a', 'volume_name': 'volume-3d832510-7bfb-4545-9a19-0643c5cab93a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a0d45e-de2f-4ac1-aaf9-2108fedbee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a0d45e-de2f-4ac1-aaf9-2108fedbee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775a3e87-3a9e-47f9-a080-7a6ee5d2bd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:24 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Volume 3d832510-7bfb-4545-9a19-0643c5cab93a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d832510-7bfb-4545-9a19-0643c5cab93a', 'volume_size': 1}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8" returned: 0 in 0.822s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] <== create_volume: return (1633ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1310197031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df12ecb7-5739-4b9d-9d44-485a6e4547f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:22Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Creating volume df12ecb7-5739-4b9d-9d44-485a6e4547f5 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:24 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:24 devstack quobyte-client[83236]: System call of process 101173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:54:24 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=147, name=volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:24 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:24 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (e19cb0ea-8583-4e86-b24b-768c50f9c854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777e1c2d-bdf3-490e-8d77-c6c08b826241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777e1c2d-bdf3-490e-8d77-c6c08b826241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-221403315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9b7323-8a1b-417b-b09f-31924bca1d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:23Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10ba1f2-f78e-48ba-a294-45df483efcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10ba1f2-f78e-48ba-a294-45df483efcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326f4fd4-e8c9-4f43-910f-ee0fa2c7f62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326f4fd4-e8c9-4f43-910f-ee0fa2c7f62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9b7323-8a1b-417b-b09f-31924bca1d02', 'volume_name': 'volume-6f9b7323-8a1b-417b-b09f-31924bca1d02', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58ccfc1-7047-4fd6-a3fa-7f5069e71175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58ccfc1-7047-4fd6-a3fa-7f5069e71175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa51bb6-f0f3-401a-a2f1-10370fe2466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Volume 6f9b7323-8a1b-417b-b09f-31924bca1d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9b7323-8a1b-417b-b09f-31924bca1d02', 'volume_size': 1}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e0134b-d452-4d11-8aa0-16f6eb86af15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af10867-d211-445c-9fdd-9824eb4064f8', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfb8cf0-5e62-48b3-aef6-8af161a1c435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (34a600d6-d226-4060-b0ba-e98d89ad535a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5a8eb5-1228-4991-acff-82bfe53fab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (f990318d-a6db-4f1b-b1d3-4540fe1a1020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca9f9f5-d20b-4a8b-80b4-ab3dafdc2bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca9f9f5-d20b-4a8b-80b4-ab3dafdc2bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763288154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdacdd13-e628-462c-b007-e32a415a64be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:24Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282ac329-b91f-4603-a3c4-1536cf673210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282ac329-b91f-4603-a3c4-1536cf673210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707b0282-19d0-467f-b059-1e4788de0f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707b0282-19d0-467f-b059-1e4788de0f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdacdd13-e628-462c-b007-e32a415a64be', 'volume_name': 'volume-fdacdd13-e628-462c-b007-e32a415a64be', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8abd8e0-65bb-4c94-8f5d-53532799a9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8abd8e0-65bb-4c94-8f5d-53532799a9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4766218a-e6b9-4615-81a8-55ba2ffce89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Volume fdacdd13-e628-462c-b007-e32a415a64be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdacdd13-e628-462c-b007-e32a415a64be', 'volume_size': 1}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5 1073741824" returned: 0 in 0.753s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5a8eb5-1228-4991-acff-82bfe53fab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1834202721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75724d4-fc26-4448-b34b-af7e00046bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:24Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472f28f9-c5a3-4ae2-98d9-24d81e602a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472f28f9-c5a3-4ae2-98d9-24d81e602a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd75fef-03d6-44b7-9bee-25e5e8acb1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd75fef-03d6-44b7-9bee-25e5e8acb1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75724d4-fc26-4448-b34b-af7e00046bc2', 'volume_name': 'volume-f75724d4-fc26-4448-b34b-af7e00046bc2', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7584998-819a-458f-ad8d-ed5464ecec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7584998-819a-458f-ad8d-ed5464ecec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff477cff-d418-464f-bff7-a61732d3aec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Volume f75724d4-fc26-4448-b34b-af7e00046bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75724d4-fc26-4448-b34b-af7e00046bc2', 'volume_size': 1}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume volume-0af10867-d211-445c-9fdd-9824eb4064f8 (0af10867-d211-445c-9fdd-9824eb4064f8): created successfully
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfb8cf0-5e62-48b3-aef6-8af161a1c435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (2ddb8750-5fd0-4898-aab0-e226a1df2bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5" returned: 0 in 0.485s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] <== create_volume: return (1256ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306235330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d832510-7bfb-4545-9a19-0643c5cab93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:23Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Creating volume 3d832510-7bfb-4545-9a19-0643c5cab93a {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:25 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3d832510-7bfb-4545-9a19-0643c5cab93a 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:26 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=148, name=volume-3d832510-7bfb-4545-9a19-0643c5cab93a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ba3932ac-9417-4a34-8fef-6d4571e371f4 tempest-CreateVolumesFromSnapshotTest-619744835 None] Created volume successfully.
Sep 17 15:54:26 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Flow 'volume_create_manager' (8a51d224-c1dc-497f-a3fc-0fcccc70fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34febf61-5c18-4838-95ab-88b8abc7bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f52518-34ff-4961-a456-d5aa2476bf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00efd2a4-9eed-4524-82eb-8de900067fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:26 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Volume volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5 (df12ecb7-5739-4b9d-9d44-485a6e4547f5): created successfully
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00efd2a4-9eed-4524-82eb-8de900067fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (81475685-01d8-4e64-b7db-16537dc80cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34febf61-5c18-4838-95ab-88b8abc7bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026d1082-527a-41a0-911f-1a0118bac2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051411dd458440e0a052376e3c0ace4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:25Z,use_quota=True,user_id='0de541cce4144ba68f9b90fe50a4ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb9ee05-6251-4393-9b2a-37b3f81077df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb9ee05-6251-4393-9b2a-37b3f81077df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03e4edf-f446-4df7-a301-f6c9c6465353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG cinder.image.glance [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Creating Keystone auth plugin from conf {{(pid=83214) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3d832510-7bfb-4545-9a19-0643c5cab93a 1073741824" returned: 0 in 0.731s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3d832510-7bfb-4545-9a19-0643c5cab93a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:26 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f5e7ae37-865c-4581-b8d1-26e954bfa22a tempest-CreateVolumesFromImageTest-1901316915 None] Created volume successfully.
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3d832510-7bfb-4545-9a19-0643c5cab93a" returned: 0 in 0.324s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] <== create_volume: return (1077ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-221403315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9b7323-8a1b-417b-b09f-31924bca1d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:23Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Creating volume 6f9b7323-8a1b-417b-b09f-31924bca1d02 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:27 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6f9b7323-8a1b-417b-b09f-31924bca1d02 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:27 devstack quobyte-client[83236]: System call of process 101182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:54:27 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=149, name=volume-6f9b7323-8a1b-417b-b09f-31924bca1d02, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775a3e87-3a9e-47f9-a080-7a6ee5d2bd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d832510-7bfb-4545-9a19-0643c5cab93a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28585ad-afd2-4bf2-be4f-e8fa34cdbd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6f9b7323-8a1b-417b-b09f-31924bca1d02 1073741824" returned: 0 in 0.519s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6f9b7323-8a1b-417b-b09f-31924bca1d02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:27 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Volume volume-3d832510-7bfb-4545-9a19-0643c5cab93a (3d832510-7bfb-4545-9a19-0643c5cab93a): created successfully
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28585ad-afd2-4bf2-be4f-e8fa34cdbd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (1dc03a84-8669-4fda-873f-8e2f07e7dbab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:28 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ff9a8918-8ad6-4973-aa0a-04fa07f0e34b tempest-CreateVolumesFromImageTest-1901316915 None] Created volume successfully.
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6f9b7323-8a1b-417b-b09f-31924bca1d02" returned: 0 in 0.441s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] <== create_volume: return (999ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03e4edf-f446-4df7-a301-f6c9c6465353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '026d1082-527a-41a0-911f-1a0118bac2dc', 'volume_name': 'volume-026d1082-527a-41a0-911f-1a0118bac2dc', 'volume_size': 1, 'image_id': '8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b9d45a172c17473b3cd080e1963afa9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '051411dd458440e0a052376e3c0ace4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed5b19fc97a752cb8a30d9db3d7cf0143604acd167eda77cbe9277d37cdca571495f6181ee774ed6798b79a2aae0a49d7c1d44a5d7dc829005c3802dfa4074ca', 'id': '8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'created_at': datetime.datetime(2025, 9, 17, 13, 54, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48e2f7-0a7a-4265-93fe-c6903402b9d0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9124880>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce20aca-cc6c-4ec0-b091-0cabec59b222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce20aca-cc6c-4ec0-b091-0cabec59b222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d594301-7f6b-4f4c-aeb6-9608a8112962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:28 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Volume 026d1082-527a-41a0-911f-1a0118bac2dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-026d1082-527a-41a0-911f-1a0118bac2dc', 'volume_size': 1, 'image_id': '8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b9d45a172c17473b3cd080e1963afa9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '051411dd458440e0a052376e3c0ace4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed5b19fc97a752cb8a30d9db3d7cf0143604acd167eda77cbe9277d37cdca571495f6181ee774ed6798b79a2aae0a49d7c1d44a5d7dc829005c3802dfa4074ca', 'id': '8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'created_at': datetime.datetime(2025, 9, 17, 13, 54, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48e2f7-0a7a-4265-93fe-c6903402b9d0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9124880>}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Cloning 026d1082-527a-41a0-911f-1a0118bac2dc from image 8f48e2f7-0a7a-4265-93fe-c6903402b9d0  at location (None, [{'url': 'file:///opt/stack/data/glance/images/8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'metadata': {}}]). {{(pid=83214) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.700s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763288154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdacdd13-e628-462c-b007-e32a415a64be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:24Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Creating volume fdacdd13-e628-462c-b007-e32a415a64be {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:28 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-fdacdd13-e628-462c-b007-e32a415a64be 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:28 devstack quobyte-client[83236]: System call of process 101186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:54:28 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=150, name=volume-fdacdd13-e628-462c-b007-e32a415a64be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa51bb6-f0f3-401a-a2f1-10370fe2466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9b7323-8a1b-417b-b09f-31924bca1d02', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e542b4c-b86b-456f-9262-f053380ef536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 15:54:28 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Image download 0.00 MB at 0.00 MB/s
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-fdacdd13-e628-462c-b007-e32a415a64be 1073741824" returned: 0 in 0.535s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-fdacdd13-e628-462c-b007-e32a415a64be {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:28 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Volume volume-6f9b7323-8a1b-417b-b09f-31924bca1d02 (6f9b7323-8a1b-417b-b09f-31924bca1d02): created successfully
Sep 17 15:54:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e542b4c-b86b-456f-9262-f053380ef536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (e19cb0ea-8583-4e86-b24b-768c50f9c854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-fdacdd13-e628-462c-b007-e32a415a64be" returned: 0 in 0.418s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] <== create_volume: return (981ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.506s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1834202721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75724d4-fc26-4448-b34b-af7e00046bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e374c310d51c440ebbad031006e8b5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:24Z,use_quota=True,user_id='b414de2deb0e4885849eeb334d364f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Creating volume f75724d4-fc26-4448-b34b-af7e00046bc2 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:29 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f75724d4-fc26-4448-b34b-af7e00046bc2 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:29 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=151, name=volume-f75724d4-fc26-4448-b34b-af7e00046bc2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[848dc1d7-80c1-4d8e-82b8-ea989cac7183]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:29 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3b339f86-03e6-4b65-a5ba-4d9f24d88992 tempest-CreateVolumesFromImageTest-1901316915 None] Created volume successfully.
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4766218a-e6b9-4615-81a8-55ba2ffce89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdacdd13-e628-462c-b007-e32a415a64be', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5b8a3c-0772-4ecf-b331-e653ca181a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f75724d4-fc26-4448-b34b-af7e00046bc2 1073741824" returned: 0 in 0.671s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f75724d4-fc26-4448-b34b-af7e00046bc2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:29 devstack sudo[101193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD
Sep 17 15:54:30 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:54:30 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Volume volume-fdacdd13-e628-462c-b007-e32a415a64be (fdacdd13-e628-462c-b007-e32a415a64be): created successfully
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5b8a3c-0772-4ecf-b331-e653ca181a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (f990318d-a6db-4f1b-b1d3-4540fe1a1020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f75724d4-fc26-4448-b34b-af7e00046bc2" returned: 0 in 0.415s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] <== create_volume: return (1112ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.454s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:30 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-2930d44f-894d-4327-8a44-0b6e94931bea tempest-CreateVolumesFromImageTest-1901316915 None] Created volume successfully.
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Creating offline snapshot 2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 of volume 0af10867-d211-445c-9fdd-9824eb4064f8 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff477cff-d418-464f-bff7-a61732d3aec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75724d4-fc26-4448-b34b-af7e00046bc2', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9782a24b-3188-461f-91f8-97a3fd911928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3477290-8ab5-4545-9e31-5e6a52a1bdc1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:30 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Volume volume-f75724d4-fc26-4448-b34b-af7e00046bc2 (f75724d4-fc26-4448-b34b-af7e00046bc2): created successfully
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9782a24b-3188-461f-91f8-97a3fd911928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:30 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Flow 'volume_create_manager' (34a600d6-d226-4060-b0ba-e98d89ad535a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:30 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f4aec9d5-9bd3-41e0-959a-e873c28c6e4b tempest-CreateVolumesFromImageTest-1901316915 None] Created volume successfully.
Sep 17 15:54:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8" returned: 0 in 0.651s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:31 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=152, name=volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-fdacdd13-e628-462c-b007-e32a415a64be-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 1G" returned: 0 in 0.566s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0af10867-d211-445c-9fdd-9824eb4064f8 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:31 devstack quobyte-client[83236]: System call of process 101204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:54:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-fdacdd13-e628-462c-b007-e32a415a64be-delete_volume" acquired by "delete_volume" :: waited 0.474s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:32 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root
Sep 17 15:54:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "qemu-img rebase -u -b volume-0af10867-d211-445c-9fdd-9824eb4064f8 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1" returned: 0 in 0.618s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:54:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD" returned: 0 in 3.164s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:33 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-quobyte-fdacdd13-e628-462c-b007-e32a415a64be" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1" returned: 0 in 0.666s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:33 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD
Sep 17 15:54:33 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1" returned: 0 in 0.190s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-fdacdd13-e628-462c-b007-e32a415a64be" acquired by "delete_volume" :: waited 0.393s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.info" returned: 0 in 0.197s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4724aa-b93c-4df7-9df9-99a49bd5b745]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-fdacdd13-e628-462c-b007-e32a415a64be {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.info" returned: 0 in 0.198s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.435s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:34 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a020f766-92e8-45d0-b98d-0628dd85aef2 tempest-CreateVolumesFromSnapshotTest-619744835 None] Create snapshot completed successfully
Sep 17 15:54:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-fdacdd13-e628-462c-b007-e32a415a64be" returned: 0 in 0.636s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-fdacdd13-e628-462c-b007-e32a415a64be {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-fdacdd13-e628-462c-b007-e32a415a64be" returned: 0 in 0.133s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-fdacdd13-e628-462c-b007-e32a415a64be" released by "delete_volume" :: held 1.077s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:34 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Created reservations ['ad5b5ae5-e19e-45f1-8b0d-61124f5d3f5f', '19bb54de-8faf-464d-b82c-cbbec0f95baf', '9671d82e-cd16-4b42-be44-f967b839ca2c', '76513229-9b85-4f56-8e2c-f1e9f005382b'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:54:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:36 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-f75724d4-fc26-4448-b34b-af7e00046bc2-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (3782a8b4-95bd-47c0-9eb0-b3349d31af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ccc95b-0e17-468e-9bfe-750644ce383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD" returned: 1 in 4.169s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Temporary image 8f48e2f7-0a7a-4265-93fe-c6903402b9d0 is fetched for user 0de541cce4144ba68f9b90fe50a4ffb6. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 15:54:36 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (e6f4b5a7-49ea-49d2-a138-4b76de6b7f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32156860-8aa1-4048-9d89-5c947084af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 1.444s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32156860-8aa1-4048-9d89-5c947084af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1992552051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad38da27-156c-4117-9d73-c6039d5aebcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:36Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91df60b-0011-4b5d-a976-5b03fa2f4392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91df60b-0011-4b5d-a976-5b03fa2f4392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93661516-7a19-409c-80ef-ffdecadbd3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93661516-7a19-409c-80ef-ffdecadbd3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad38da27-156c-4117-9d73-c6039d5aebcc', 'volume_name': 'volume-ad38da27-156c-4117-9d73-c6039d5aebcc', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e361bd52-e05c-4907-93b5-b0858e9cb18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e361bd52-e05c-4907-93b5-b0858e9cb18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1eafe72-ada4-49f9-b40f-0b1118fa3ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:36 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume ad38da27-156c-4117-9d73-c6039d5aebcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad38da27-156c-4117-9d73-c6039d5aebcc', 'volume_size': 1}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1992552051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad38da27-156c-4117-9d73-c6039d5aebcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:36Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Creating volume ad38da27-156c-4117-9d73-c6039d5aebcc {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:36 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ad38da27-156c-4117-9d73-c6039d5aebcc 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-f75724d4-fc26-4448-b34b-af7e00046bc2-delete_volume" acquired by "delete_volume" :: waited 0.633s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:37 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=154, name=volume-ad38da27-156c-4117-9d73-c6039d5aebcc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ccc95b-0e17-468e-9bfe-750644ce383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-756733511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a48031b-6502-4759-a901-c9cb5a8cbf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:35Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a7cc8d-69f1-4d0f-8e1e-241a38aa8c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a7cc8d-69f1-4d0f-8e1e-241a38aa8c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfeb549e-aa51-4d4b-82d5-6a0c20f16529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfeb549e-aa51-4d4b-82d5-6a0c20f16529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a48031b-6502-4759-a901-c9cb5a8cbf96', 'volume_name': 'volume-8a48031b-6502-4759-a901-c9cb5a8cbf96', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb272e8-0f51-42ec-a51a-9605f023c4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb272e8-0f51-42ec-a51a-9605f023c4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a141d0ef-c4ae-4497-91b0-efe24128b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:37 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume 8a48031b-6502-4759-a901-c9cb5a8cbf96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a48031b-6502-4759-a901-c9cb5a8cbf96', 'volume_size': 1}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:37 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Deleted volume successfully.
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ad38da27-156c-4117-9d73-c6039d5aebcc 1073741824" returned: 0 in 0.808s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:37 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ad38da27-156c-4117-9d73-c6039d5aebcc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:38 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (1a5d79fc-6409-4160-ab7e-b8a0c747f4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77321ed-81c0-47e0-accb-a7da68d59238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a209ed32-ee3a-4468-b2a8-241a749bd026 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-fdacdd13-e628-462c-b007-e32a415a64be-delete_volume" released by "delete_volume" :: held 6.225s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:38 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-quobyte-f75724d4-fc26-4448-b34b-af7e00046bc2" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:38 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (38420734-5c58-4669-8331-7bd9ff6dda34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b62b842-a51b-4a52-adf7-c4fa46aa8fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ad38da27-156c-4117-9d73-c6039d5aebcc" returned: 0 in 0.556s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] <== create_volume: return (1389ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-756733511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a48031b-6502-4759-a901-c9cb5a8cbf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:35Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Creating volume 8a48031b-6502-4759-a901-c9cb5a8cbf96 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:38 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8a48031b-6502-4759-a901-c9cb5a8cbf96 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:38 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=155, name=volume-8a48031b-6502-4759-a901-c9cb5a8cbf96, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77321ed-81c0-47e0-accb-a7da68d59238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1379751155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1753c5bb-cdf5-4d8a-a819-30d7e6376bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:37Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844675f0-3f49-4c0a-a6be-4e6810658761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844675f0-3f49-4c0a-a6be-4e6810658761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481c0f34-437d-4f03-88c7-a6ddee38e8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481c0f34-437d-4f03-88c7-a6ddee38e8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1753c5bb-cdf5-4d8a-a819-30d7e6376bbe', 'volume_name': 'volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a035a6ef-2dd4-46c9-92a8-c3a314b4ec2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a035a6ef-2dd4-46c9-92a8-c3a314b4ec2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a152ee-34df-40aa-9f93-5fcc5163b805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume 1753c5bb-cdf5-4d8a-a819-30d7e6376bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe', 'volume_size': 1}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b62b842-a51b-4a52-adf7-c4fa46aa8fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016117448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:37Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b390b3-3145-4521-8dc7-d02265ccee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b390b3-3145-4521-8dc7-d02265ccee70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775b62cf-71a7-4489-8997-6b1805185194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775b62cf-71a7-4489-8997-6b1805185194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a', 'volume_name': 'volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1219548a-946a-4e6f-bed2-10aabad045cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1219548a-946a-4e6f-bed2-10aabad045cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d40e1b-0454-4a2d-90d0-e3cd96a51e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:38 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a', 'volume_size': 1}
Sep 17 15:54:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1eafe72-ada4-49f9-b40f-0b1118fa3ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad38da27-156c-4117-9d73-c6039d5aebcc', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5b5037-b240-40b4-9916-f2117b45027f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:39 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (83d9d616-e43b-4dbb-8685-2f057d8c0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5b3ff7-0e13-4a03-a598-f8717cdc3824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-f75724d4-fc26-4448-b34b-af7e00046bc2" acquired by "delete_volume" :: waited 0.837s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5b3ff7-0e13-4a03-a598-f8717cdc3824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1253289375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee215e89-729a-49d0-bb6c-53b50334d916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:38Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7600b65-95fd-40ff-b81d-547a5d64505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7600b65-95fd-40ff-b81d-547a5d64505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14949694-3582-4944-bc48-2bd1bbcf4457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14949694-3582-4944-bc48-2bd1bbcf4457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee215e89-729a-49d0-bb6c-53b50334d916', 'volume_name': 'volume-ee215e89-729a-49d0-bb6c-53b50334d916', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6617c8-a922-4885-9f7b-54bb55014d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6617c8-a922-4885-9f7b-54bb55014d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9ba6d5-0413-41e3-b233-137a808a3b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:39 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume ee215e89-729a-49d0-bb6c-53b50334d916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee215e89-729a-49d0-bb6c-53b50334d916', 'volume_size': 1}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f5dad-ef16-478d-a93d-b9adab3a72ef]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f9619-5d2f-45eb-8672-7817d6f1690d]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f75724d4-fc26-4448-b34b-af7e00046bc2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:39 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume volume-ad38da27-156c-4117-9d73-c6039d5aebcc (ad38da27-156c-4117-9d73-c6039d5aebcc): created successfully
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5b5037-b240-40b4-9916-f2117b45027f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (e6f4b5a7-49ea-49d2-a138-4b76de6b7f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8a48031b-6502-4759-a901-c9cb5a8cbf96 1073741824" returned: 0 in 1.267s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:39 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8a48031b-6502-4759-a901-c9cb5a8cbf96 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:39 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD
Sep 17 15:54:39 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:54:40 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-eda5a26c-77b8-4644-b5aa-70dc1ce43f17 tempest-CreateVolumesFromSnapshotTest-619744835 None] Created volume successfully.
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8a48031b-6502-4759-a901-c9cb5a8cbf96" returned: 0 in 0.373s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f75724d4-fc26-4448-b34b-af7e00046bc2" returned: 0 in 0.881s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] <== create_volume: return (1693ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f75724d4-fc26-4448-b34b-af7e00046bc2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1379751155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1753c5bb-cdf5-4d8a-a819-30d7e6376bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:37Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Creating volume 1753c5bb-cdf5-4d8a-a819-30d7e6376bbe {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:40 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:40 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=156, name=volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a141d0ef-c4ae-4497-91b0-efe24128b132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a48031b-6502-4759-a901-c9cb5a8cbf96', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b04e7df-d756-4bb8-85cd-e5a472b7f61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:40 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume volume-8a48031b-6502-4759-a901-c9cb5a8cbf96 (8a48031b-6502-4759-a901-c9cb5a8cbf96): created successfully
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b04e7df-d756-4bb8-85cd-e5a472b7f61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (3782a8b4-95bd-47c0-9eb0-b3349d31af0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f75724d4-fc26-4448-b34b-af7e00046bc2" returned: 0 in 0.744s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe 1073741824" returned: 0 in 0.584s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:41 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a84f9ad5-e817-4880-b9fd-60deacb7416a tempest-CreateVolumesFromSnapshotTest-619744835 None] Created volume successfully.
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe" returned: 0 in 0.396s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-f75724d4-fc26-4448-b34b-af7e00046bc2" released by "delete_volume" :: held 2.221s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] <== create_volume: return (1117ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.504s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016117448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:37Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Creating volume a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:41 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:41 devstack quobyte-client[83236]: System call of process 101274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:54:41 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=157, name=volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a152ee-34df-40aa-9f93-5fcc5163b805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd90263c-e9b0-4144-af98-dd13c52e9c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:42 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe (1753c5bb-cdf5-4d8a-a819-30d7e6376bbe): created successfully
Sep 17 15:54:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd90263c-e9b0-4144-af98-dd13c52e9c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:42 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (1a5d79fc-6409-4160-ab7e-b8a0c747f4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a 1073741824" returned: 0 in 0.766s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:42 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Sep 17 15:54:42 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Created reservations ['83791ddc-afc0-4583-b9c4-c8b2c86479ec', 'ce378206-a344-4735-ae1e-2e9228bd374a', 'dbcc62d1-fd71-404c-aceb-0a26348f72d2', '58636958-2565-41ea-81c5-a13999a06491'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:54:42 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-495351ff-99ce-458c-a5a9-f6fb6deefba8 tempest-CreateVolumesFromSnapshotTest-619744835 None] Created volume successfully.
Sep 17 15:54:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD" returned: 0 in 3.494s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a" returned: 0 in 0.695s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] <== create_volume: return (1535ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1253289375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee215e89-729a-49d0-bb6c-53b50334d916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7b63987ea1467d9a6134550c9c9aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:38Z,use_quota=True,user_id='87e036b9aab04d94a08f512c9de718d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Creating volume ee215e89-729a-49d0-bb6c-53b50334d916 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:43 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ee215e89-729a-49d0-bb6c-53b50334d916 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:43 devstack sudo[101278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD
Sep 17 15:54:43 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 15:54:43 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=158, name=volume-ee215e89-729a-49d0-bb6c-53b50334d916, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d40e1b-0454-4a2d-90d0-e3cd96a51e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857b26d4-a92f-46b3-a3a8-683829f6bff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-6f9b7323-8a1b-417b-b09f-31924bca1d02-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:44 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a (a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a): created successfully
Sep 17 15:54:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857b26d4-a92f-46b3-a3a8-683829f6bff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (38420734-5c58-4669-8331-7bd9ff6dda34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ee215e89-729a-49d0-bb6c-53b50334d916 1073741824" returned: 0 in 1.106s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.551s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ee215e89-729a-49d0-bb6c-53b50334d916 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:44 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:54:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-6f9b7323-8a1b-417b-b09f-31924bca1d02-delete_volume" acquired by "delete_volume" :: waited 0.722s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:44 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-db962703-25b9-4133-a64c-5ae47d11aa1f tempest-CreateVolumesFromSnapshotTest-619744835 None] Created volume successfully.
Sep 17 15:54:44 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Deleted volume successfully.
Sep 17 15:54:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ee215e89-729a-49d0-bb6c-53b50334d916" returned: 0 in 0.633s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] <== create_volume: return (1806ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:45 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-quobyte-6f9b7323-8a1b-417b-b09f-31924bca1d02" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9ba6d5-0413-41e3-b233-137a808a3b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee215e89-729a-49d0-bb6c-53b50334d916', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b783845a-dbf9-4b68-b2f5-e282ef123f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-1f0c846f-6f38-4f94-9c21-0ead39dad3ba tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-f75724d4-fc26-4448-b34b-af7e00046bc2-delete_volume" released by "delete_volume" :: held 8.119s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:45 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume volume-ee215e89-729a-49d0-bb6c-53b50334d916 (ee215e89-729a-49d0-bb6c-53b50334d916): created successfully
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b783845a-dbf9-4b68-b2f5-e282ef123f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Flow 'volume_create_manager' (83d9d616-e43b-4dbb-8685-2f057d8c0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-6f9b7323-8a1b-417b-b09f-31924bca1d02" acquired by "delete_volume" :: waited 0.146s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:45 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-f443e98a-fa21-4c90-89ba-2e9cbb3906ac tempest-CreateVolumesFromSnapshotTest-619744835 None] Created volume successfully.
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f51d8c8-1315-45ce-a3ec-d76d5febe6b5]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6f9b7323-8a1b-417b-b09f-31924bca1d02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:45 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD" returned: 1 in 2.894s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026d1082-527a-41a0-911f-1a0118bac2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051411dd458440e0a052376e3c0ace4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:54:25Z,use_quota=True,user_id='0de541cce4144ba68f9b90fe50a4ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Creating volume 026d1082-527a-41a0-911f-1a0118bac2dc {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:54:45 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:54:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:45 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=159, name=volume-026d1082-527a-41a0-911f-1a0118bac2dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:45 devstack quobyte-client[83236]: System call of process 101288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6f9b7323-8a1b-417b-b09f-31924bca1d02" returned: 0 in 0.697s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6f9b7323-8a1b-417b-b09f-31924bca1d02 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-ee215e89-729a-49d0-bb6c-53b50334d916-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc 1073741824" returned: 0 in 0.641s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-6f9b7323-8a1b-417b-b09f-31924bca1d02" returned: 0 in 0.424s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-ee215e89-729a-49d0-bb6c-53b50334d916-delete_volume" acquired by "delete_volume" :: waited 0.302s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc" returned: 0 in 0.350s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] <== create_volume: return (1032ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-6f9b7323-8a1b-417b-b09f-31924bca1d02" released by "delete_volume" :: held 1.516s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:46 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-quobyte-ee215e89-729a-49d0-bb6c-53b50334d916" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:46 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Attempting download of 8f48e2f7-0a7a-4265-93fe-c6903402b9d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'metadata': {}}])) to volume 026d1082-527a-41a0-911f-1a0118bac2dc. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 15:54:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-ee215e89-729a-49d0-bb6c-53b50334d916" acquired by "delete_volume" :: waited 0.098s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c02b88-5d37-4c67-9e96-40a098160f91]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ee215e89-729a-49d0-bb6c-53b50334d916 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:47 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Created reservations ['3718cbb8-e20f-48a9-860a-2d9628b01b6c', 'ab89aaff-d95d-4cfb-8490-1f9177f81bcb', 'b29dcb27-7969-4f14-a3c0-dfebb6b25d0e', 'bab18908-e4ee-405f-8eb9-3d93f9f89a53'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:54:47 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8c316f-82a1-4b63-8881-f5dc981b9d5c]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_d8qihqu5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ee215e89-729a-49d0-bb6c-53b50334d916" returned: 0 in 0.710s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ee215e89-729a-49d0-bb6c-53b50334d916 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ee215e89-729a-49d0-bb6c-53b50334d916" returned: 0 in 0.333s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_d8qihqu5" returned: 0 in 0.681s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_d8qihqu5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-ee215e89-729a-49d0-bb6c-53b50334d916" released by "delete_volume" :: held 1.548s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_d8qihqu5" returned: 1 in 0.757s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_d8qihqu5' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e15d9f6-67ce-4bac-9653-c1c2dd78479c]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.527s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-3d832510-7bfb-4545-9a19-0643c5cab93a-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:49 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Deleted volume successfully.
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-3d832510-7bfb-4545-9a19-0643c5cab93a-delete_volume" acquired by "delete_volume" :: waited 0.219s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-3980c448-5661-49f3-bf11-adb8ac0878e7 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-6f9b7323-8a1b-417b-b09f-31924bca1d02-delete_volume" released by "delete_volume" :: held 5.154s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:49 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Created reservations ['1dd8c55b-2b89-46c5-9003-bb37a22bf3f0', '9babcae3-510f-41c6-8cbe-6db4479f0749', 'dc68b3ec-64e0-4f34-a465-a950911b82be', 'a8c16249-e290-4d14-809d-d15d876de36f'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:54:50 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-quobyte-3d832510-7bfb-4545-9a19-0643c5cab93a" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD" returned: 1 in 0.563s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] 8f48e2f7-0a7a-4265-93fe-c6903402b9d0 was raw, converting to raw {{(pid=83214) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:50 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=159, name=volume-026d1082-527a-41a0-911f-1a0118bac2dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-3d832510-7bfb-4545-9a19-0643c5cab93a" acquired by "delete_volume" :: waited 0.348s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc" returned: 0 in 0.344s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8f48e2f7-0a7a-4265-93fe-c6903402b9d0_i4k8dl2idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:54:50 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Converted 0.00 MB image at 0.00 MB/s
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e135b6b-572e-471e-826d-d65de67a5662]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3d832510-7bfb-4545-9a19-0643c5cab93a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:50 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a-delete_volume" acquired by "delete_volume" :: waited 0.341s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc 1G" returned: 0 in 0.925s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.404s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704bb6e-6bf9-4505-aee4-a8fe1a283125]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3d832510-7bfb-4545-9a19-0643c5cab93a" returned: 0 in 0.844s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3d832510-7bfb-4545-9a19-0643c5cab93a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Deleted volume successfully.
Sep 17 15:54:52 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-quobyte-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-3d832510-7bfb-4545-9a19-0643c5cab93a" returned: 0 in 0.547s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e75a8208-1413-4dea-8a27-2187da8cc1d0 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-ee215e89-729a-49d0-bb6c-53b50334d916-delete_volume" released by "delete_volume" :: held 5.563s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc" returned: 0 in 0.637s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-3d832510-7bfb-4545-9a19-0643c5cab93a" released by "delete_volume" :: held 1.953s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a" acquired by "delete_volume" :: waited 0.412s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3263e18-5906-446f-aa9a-bdb0e3437b54]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc" returned: 1 in 0.739s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Downloaded image 8f48e2f7-0a7a-4265-93fe-c6903402b9d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'metadata': {}}])) to volume 026d1082-527a-41a0-911f-1a0118bac2dc successfully. {{(pid=83214) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Temporary image 8f48e2f7-0a7a-4265-93fe-c6903402b9d0 for user 0de541cce4144ba68f9b90fe50a4ffb6 is deleted. {{(pid=83214) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.volume_utils [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Marking volume 026d1082-527a-41a0-911f-1a0118bac2dc as bootable. {{(pid=83214) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Copying metadata from image 8f48e2f7-0a7a-4265-93fe-c6903402b9d0 to 026d1082-527a-41a0-911f-1a0118bac2dc. {{(pid=83214) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Creating volume glance metadata for volume 026d1082-527a-41a0-911f-1a0118bac2dc backed by image 8f48e2f7-0a7a-4265-93fe-c6903402b9d0 with: {'image_id': '8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b9d45a172c17473b3cd080e1963afa9b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83214) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Created reservations ['cc03aacc-a344-4c73-b40a-f7b04d7df0e8', 'a047eed1-cd54-45a0-8377-c2dbe024d373', 'e674cc02-557f-4ba3-813c-3ea431fbb451', '1a31af36-9c0d-464f-bd7a-05d9c0d65aad'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d594301-7f6b-4f4c-aeb6-9608a8112962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026d1082-527a-41a0-911f-1a0118bac2dc', 'volume_size': 1, 'image_id': '8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b9d45a172c17473b3cd080e1963afa9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '051411dd458440e0a052376e3c0ace4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed5b19fc97a752cb8a30d9db3d7cf0143604acd167eda77cbe9277d37cdca571495f6181ee774ed6798b79a2aae0a49d7c1d44a5d7dc829005c3802dfa4074ca', 'id': '8f48e2f7-0a7a-4265-93fe-c6903402b9d0', 'created_at': datetime.datetime(2025, 9, 17, 13, 54, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 13, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48e2f7-0a7a-4265-93fe-c6903402b9d0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd4a9124880>}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b539bcb-e166-40c7-83be-a1e4cec1f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a" returned: 0 in 0.659s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:53 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Volume volume-026d1082-527a-41a0-911f-1a0118bac2dc (026d1082-527a-41a0-911f-1a0118bac2dc): created successfully
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b539bcb-e166-40c7-83be-a1e4cec1f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Flow 'volume_create_manager' (8a51d224-c1dc-497f-a3fc-0fcccc70fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Acquiring lock "cinder-026d1082-527a-41a0-911f-1a0118bac2dc-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-df12ecb7-5739-4b9d-9d44-485a6e4547f5-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:53 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-75eed007-0aef-4f46-93b4-dad0f03137cb tempest-VolumeImageDependencyTests-302538400 None] Created volume successfully.
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a" returned: 0 in 0.517s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-df12ecb7-5739-4b9d-9d44-485a6e4547f5-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a" released by "delete_volume" :: held 1.287s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Lock "cinder-026d1082-527a-41a0-911f-1a0118bac2dc-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:53 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Acquiring lock "cinder-quobyte-026d1082-527a-41a0-911f-1a0118bac2dc" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Lock "cinder-quobyte-026d1082-527a-41a0-911f-1a0118bac2dc" acquired by "delete_volume" :: waited 0.377s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:54 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c262a01-4ebf-4a80-adf0-523d2c0f3475]: (4, 'raw') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.545s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:54 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:54:54 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Deleted volume successfully.
Sep 17 15:54:54 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "cinder-quobyte-df12ecb7-5739-4b9d-9d44-485a6e4547f5" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:54 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Created reservations ['8bc4c2eb-d76a-411e-8a29-8850be2911a3', 'ad1e2f5e-c61d-4055-929c-c8913045d3f8', '616e70bf-49a7-4d18-a657-58468db998d7', 'c2a33641-4d6e-4032-854a-dde589800df1'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:54:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-df12ecb7-5739-4b9d-9d44-485a6e4547f5" acquired by "delete_volume" :: waited 0.120s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc" returned: 0 in 0.580s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:55 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[982966e2-cbc4-4c08-af8d-4eb7329b2de1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:55 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a1cb6811-4418-4a92-ac99-1c92870e0cd0 tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-3d832510-7bfb-4545-9a19-0643c5cab93a-delete_volume" released by "delete_volume" :: held 6.043s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc" returned: 1 in 0.745s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc' failed. Not Retrying. {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 15:54:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.039s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-026d1082-527a-41a0-911f-1a0118bac2dc" returned: 0 in 0.328s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5" returned: 0 in 0.894s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Lock "cinder-quobyte-026d1082-527a-41a0-911f-1a0118bac2dc" released by "delete_volume" :: held 2.055s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.614s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-df12ecb7-5739-4b9d-9d44-485a6e4547f5" returned: 0 in 0.449s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:56 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Deleted volume successfully.
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-quobyte-df12ecb7-5739-4b9d-9d44-485a6e4547f5" released by "delete_volume" :: held 1.790s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Created reservations ['3e3aef56-8641-42f7-96bc-d8a9c7b524fe', 'f636af31-8da4-4d31-9089-d278ff9fb1b3', 'b9e9bbca-a861-442f-a440-a5d2448b9e37', 'd9266203-9e93-451d-8fd1-c212ac2353f2'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cd7a28c6-9e30-4296-9414-71d41ca15c47 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-a40e4b17-5fda-4ab8-a6ea-2e7ef5e6666a-delete_volume" released by "delete_volume" :: held 5.562s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Created reservations ['51929abe-6986-40f1-a31f-c5743e5b9020', '11bebb77-06b9-4ed2-a0e1-91d7244d1747', '925cc951-7388-4cee-8e8f-b1190735e02e', '66fd8528-a795-4528-9956-ecf8850a7b67'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:54:56 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:54:56 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-quobyte-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:54:57 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe" acquired by "delete_volume" :: waited 0.035s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:54:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:57 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:57 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba77351-ea3a-48cb-b41c-e6d7b585e4d1]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:54:57 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.989s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:54:58 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Deleted volume successfully.
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe" returned: 0 in 0.867s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-32affdd3-dfd8-4878-bdfb-94ab256cee50 tempest-VolumeImageDependencyTests-302538400 None] Lock "cinder-026d1082-527a-41a0-911f-1a0118bac2dc-delete_volume" released by "delete_volume" :: held 4.815s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:54:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe" returned: 0 in 0.549s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe" released by "delete_volume" :: held 2.057s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.378s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:54:59 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Deleted volume successfully.
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-cbd36154-83b7-4ce6-9c2a-aff0fae27e2a tempest-CreateVolumesFromImageTest-1901316915 None] Lock "cinder-df12ecb7-5739-4b9d-9d44-485a6e4547f5-delete_volume" released by "delete_volume" :: held 5.506s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Created reservations ['7edb67fc-0e52-4b3d-861e-31e804df0597', '6a85e72e-0321-4393-b9d3-1c0a54a04b14', '79a2661f-53d6-4f99-aceb-6b53886513e7', '956b8c96-a821-4e1a-ab93-ccbfc6365377'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:54:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-ad38da27-156c-4117-9d73-c6039d5aebcc-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.369s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:00 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:00 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Deleted volume successfully.
Sep 17 15:55:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-ad38da27-156c-4117-9d73-c6039d5aebcc-delete_volume" acquired by "delete_volume" :: waited 0.288s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-5cebad3b-6a70-4178-b9f2-a367271aab61 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-1753c5bb-cdf5-4d8a-a819-30d7e6376bbe-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:00 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-quobyte-ad38da27-156c-4117-9d73-c6039d5aebcc" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-ad38da27-156c-4117-9d73-c6039d5aebcc" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:00 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ef9d18-3695-4d3b-81ea-30ee35b41647]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ad38da27-156c-4117-9d73-c6039d5aebcc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ad38da27-156c-4117-9d73-c6039d5aebcc" returned: 0 in 0.469s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ad38da27-156c-4117-9d73-c6039d5aebcc {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ad38da27-156c-4117-9d73-c6039d5aebcc" returned: 0 in 0.117s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-ad38da27-156c-4117-9d73-c6039d5aebcc" released by "delete_volume" :: held 0.792s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Created reservations ['a1f64e33-0d26-407b-ad84-926788c49215', 'c81b25f1-db36-4d27-8013-8fdf8bc366e7', '03e67105-b5aa-4002-a6f6-98bdc43eab16', 'e17a5b2e-758d-42f1-bd6c-11b1344c6de6'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.107s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:01 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:02 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Deleted volume successfully.
Sep 17 15:55:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b56c8a7b-5c44-41ec-bc3e-58772afc9fc5 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-ad38da27-156c-4117-9d73-c6039d5aebcc-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-8a48031b-6502-4759-a901-c9cb5a8cbf96-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-8a48031b-6502-4759-a901-c9cb5a8cbf96-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:02 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-quobyte-8a48031b-6502-4759-a901-c9cb5a8cbf96" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-8a48031b-6502-4759-a901-c9cb5a8cbf96" acquired by "delete_volume" :: waited 0.019s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:02 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[419ab2e2-606b-4329-95b4-a6ea8eb69386]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8a48031b-6502-4759-a901-c9cb5a8cbf96 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8a48031b-6502-4759-a901-c9cb5a8cbf96" returned: 0 in 0.524s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8a48031b-6502-4759-a901-c9cb5a8cbf96 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-8a48031b-6502-4759-a901-c9cb5a8cbf96" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-8a48031b-6502-4759-a901-c9cb5a8cbf96" released by "delete_volume" :: held 0.823s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:03 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Created reservations ['3a514ff0-b5cf-439e-860a-fa2b6120a3c9', '0534523b-8979-4b1f-9fb5-10b0468f97e5', '8a29417c-defb-49e3-92fb-f6c05fd79397', '21107248-4350-4710-b327-5b296e206407'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.104s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:04 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Deleted volume successfully.
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-80d7513f-bf82-469f-9d21-fffef5c1d77e tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-8a48031b-6502-4759-a901-c9cb5a8cbf96-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:04 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-quobyte-0af10867-d211-445c-9fdd-9824eb4064f8" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-0af10867-d211-445c-9fdd-9824eb4064f8" acquired by "delete_snapshot" :: waited 0.061s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-quobyte-2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Deleting offline snapshot 2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 of volume 0af10867-d211-445c-9fdd-9824eb4064f8 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] snapshot_file for this snap is: volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[03802acb-fe59-465f-ac4d-bb2c3b8e8ea3]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1" returned: 0 in 0.458s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0af10867-d211-445c-9fdd-9824eb4064f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:55:05 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c632d8-2ac0-48d2-9fa5-c66a4757397f]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8" returned: 0 in 0.449s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1" returned: 0 in 0.260s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:06 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8.2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1" returned: 0 in 0.114s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1" released by "_delete_snapshot" :: held 1.653s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:06 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-0af10867-d211-445c-9fdd-9824eb4064f8" released by "delete_snapshot" :: held 1.685s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:07 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Created reservations ['9c7e7556-9c3f-4616-8a5d-9f2d8ddc7b95', '776d9f23-a575-416f-bd99-bcf31c92a868', '60c7de6c-2e87-45fb-b9b4-90ac387759e9', 'becf804b-c714-4ae9-b69e-636fddb65118'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:07 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Delete snapshot completed successfully.
Sep 17 15:55:07 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a17ea693-39f5-4e8d-8fe5-0e94a4916720 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-2f4039ca-d5e5-4d8f-9fcc-90aded8ee2a1-delete_snapshot" released by "delete_snapshot" :: held 2.550s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-0af10867-d211-445c-9fdd-9824eb4064f8-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-0af10867-d211-445c-9fdd-9824eb4064f8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:08 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "cinder-quobyte-0af10867-d211-445c-9fdd-9824eb4064f8" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:08 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-0af10867-d211-445c-9fdd-9824eb4064f8" acquired by "delete_volume" :: waited 0.016s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:08 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eacdfc-d1c4-4272-b1c0-08090efa9967]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8" returned: 0 in 0.580s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:08 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-0af10867-d211-445c-9fdd-9824eb4064f8" returned: 0 in 0.144s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-quobyte-0af10867-d211-445c-9fdd-9824eb4064f8" released by "delete_volume" :: held 0.924s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Created reservations ['46b70968-006b-4884-aa87-4d95f89b9b07', 'd5d86117-f0b7-4af9-910c-1ca3ac5f5310', 'dceef84d-8fa2-4afd-8625-5c6d010d8673', 'caa4e5d8-c20a-48bc-8bb5-c71f857818bb'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.125s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:09 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:09 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Deleted volume successfully.
Sep 17 15:55:10 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-fb60fe06-e7b8-4ddd-a7f1-09abf2e275a9 tempest-CreateVolumesFromSnapshotTest-619744835 None] Lock "cinder-0af10867-d211-445c-9fdd-9824eb4064f8-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:55:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.082s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.418s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:13 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:16 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (a14ad3f5-90bc-4326-9a7d-4fd31a6fddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd20dd6b-8b28-4d4f-8b66-71d37d0b3b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd20dd6b-8b28-4d4f-8b66-71d37d0b3b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551838951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ff3743-7d2f-43ae-93ee-b788ce79d7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:16Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3940836-ed9e-4966-af65-1c38cd9a06fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3940836-ed9e-4966-af65-1c38cd9a06fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b19c71-16e5-42bb-b061-a11ba4f9d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b19c71-16e5-42bb-b061-a11ba4f9d589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ff3743-7d2f-43ae-93ee-b788ce79d7c1', 'volume_name': 'volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e374179-75ae-4f43-8ece-a1c1466550b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e374179-75ae-4f43-8ece-a1c1466550b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1306de-b7c0-42a6-bc59-4d198077c897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:16 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume e4ff3743-7d2f-43ae-93ee-b788ce79d7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1', 'volume_size': 1}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551838951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ff3743-7d2f-43ae-93ee-b788ce79d7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:16Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Creating volume e4ff3743-7d2f-43ae-93ee-b788ce79d7c1 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:16 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:55:16 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:16 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=160, name=volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1 1073741824" returned: 0 in 0.351s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1" returned: 0 in 0.142s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] <== create_volume: return (564ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.577s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1306de-b7c0-42a6-bc59-4d198077c897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1085729f-cb66-4059-8d53-96a2a6c05c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:17 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1 (e4ff3743-7d2f-43ae-93ee-b788ce79d7c1): created successfully
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1085729f-cb66-4059-8d53-96a2a6c05c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (a14ad3f5-90bc-4326-9a7d-4fd31a6fddb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:17 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-bf4a3de4-592e-495e-8e0e-5ba8a14552eb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created volume successfully.
Sep 17 15:55:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=90,cinder:UPDATE=125,cinder:DELETE=15,cinder:INSERT=35 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:55:18 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:SELECT=80,cinder:UPDATE=135,cinder:DELETE=11,cinder:INSERT=26 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:55:19 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (04a71c78-7982-45ed-ad30-71110e497c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7c803b-f881-45b9-936d-efecfd1948d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7c803b-f881-45b9-936d-efecfd1948d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-621369899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:19Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011c8912-f7b7-4059-96a6-0ddb1d2c01fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011c8912-f7b7-4059-96a6-0ddb1d2c01fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188506c1-d356-4402-b567-bee4b780b5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188506c1-d356-4402-b567-bee4b780b5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2', 'volume_name': 'volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc5fb40-37aa-4e7f-9c96-419b10085a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc5fb40-37aa-4e7f-9c96-419b10085a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa500dcc-0a49-44c7-beb6-bc5eef78fb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:19 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2', 'volume_size': 1}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-621369899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:19Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Creating volume bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:19 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:55:19 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:19 devstack quobyte-client[83236]: System call of process 101619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:55:19 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=161, name=volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2 1073741824" returned: 0 in 1.120s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:20 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:20 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (a70d3e76-bdd8-444a-91f3-7021e852f25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a057de70-8759-4171-9746-f44a2d22b5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:21 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (24be47f9-ecdf-4bc9-ac62-e8788c465a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4ef86e-152c-4876-8e57-217b80752127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:21 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (4eedc015-96e5-49f3-a0c1-d084ae43b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b27a152-b334-40bb-8aa2-d1e6d1fa0c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2" returned: 0 in 0.963s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a057de70-8759-4171-9746-f44a2d22b5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-718442407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135a1e47-d295-4958-a30e-6ee26c7e394f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:19Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c93a7f-9f79-4fbe-970b-498be36937c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c93a7f-9f79-4fbe-970b-498be36937c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da5bec5-940e-4101-a643-4af8a00d2e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da5bec5-940e-4101-a643-4af8a00d2e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '135a1e47-d295-4958-a30e-6ee26c7e394f', 'volume_name': 'volume-135a1e47-d295-4958-a30e-6ee26c7e394f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c708d59f-b460-4afd-b613-6ca93df5618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c708d59f-b460-4afd-b613-6ca93df5618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c51963e-8463-4d7b-9026-c168e7789b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:21 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume 135a1e47-d295-4958-a30e-6ee26c7e394f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-135a1e47-d295-4958-a30e-6ee26c7e394f', 'volume_size': 1}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] <== create_volume: return (2212ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-718442407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135a1e47-d295-4958-a30e-6ee26c7e394f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:19Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Creating volume 135a1e47-d295-4958-a30e-6ee26c7e394f {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:21 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:55:21 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-135a1e47-d295-4958-a30e-6ee26c7e394f 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:21 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=162, name=volume-135a1e47-d295-4958-a30e-6ee26c7e394f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b27a152-b334-40bb-8aa2-d1e6d1fa0c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441875962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560b626a-7346-4db8-8350-357da8bc659f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:20Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d01c1a0-34d4-4e1f-bc6c-03378443e535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d01c1a0-34d4-4e1f-bc6c-03378443e535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb55de05-d93c-4804-951a-3a705bcd0d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb55de05-d93c-4804-951a-3a705bcd0d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560b626a-7346-4db8-8350-357da8bc659f', 'volume_name': 'volume-560b626a-7346-4db8-8350-357da8bc659f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f643351c-6f31-44d3-92c4-6cfa1db702f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f643351c-6f31-44d3-92c4-6cfa1db702f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec7fc78-5f93-4a41-909d-ff6b3ff2e8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume 560b626a-7346-4db8-8350-357da8bc659f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560b626a-7346-4db8-8350-357da8bc659f', 'volume_size': 1}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4ef86e-152c-4876-8e57-217b80752127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611092768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97a1612-0768-4dfe-9e5f-a477504a9616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:20Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49649a72-c236-4940-b145-966b64d78241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49649a72-c236-4940-b145-966b64d78241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cc0bf8-fd37-4b9f-bc68-b5b53b78b7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cc0bf8-fd37-4b9f-bc68-b5b53b78b7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97a1612-0768-4dfe-9e5f-a477504a9616', 'volume_name': 'volume-b97a1612-0768-4dfe-9e5f-a477504a9616', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd61b63-9fd1-4e1b-9eec-5648466d1eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd61b63-9fd1-4e1b-9eec-5648466d1eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673fa075-20c6-4e66-8da0-2560146f5777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume b97a1612-0768-4dfe-9e5f-a477504a9616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97a1612-0768-4dfe-9e5f-a477504a9616', 'volume_size': 1}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa500dcc-0a49-44c7-beb6-bc5eef78fb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f050d8-0e3e-40e7-9f6f-3ce2dad9fd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (1924e663-2f3a-491c-8b38-fdaac0dc9aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f39284-e871-4279-a845-8b619e05e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2 (bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2): created successfully
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f050d8-0e3e-40e7-9f6f-3ce2dad9fd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (04a71c78-7982-45ed-ad30-71110e497c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-135a1e47-d295-4958-a30e-6ee26c7e394f 1073741824" returned: 0 in 0.905s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-135a1e47-d295-4958-a30e-6ee26c7e394f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f39284-e871-4279-a845-8b619e05e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377323467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89e4184-6411-422d-8746-6471a27fba36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:21Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f948ac37-3604-4b4e-9e51-d911e84e7d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f948ac37-3604-4b4e-9e51-d911e84e7d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:22 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e085bb86-05ad-489f-b712-a0acc8198808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e085bb86-05ad-489f-b712-a0acc8198808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b89e4184-6411-422d-8746-6471a27fba36', 'volume_name': 'volume-b89e4184-6411-422d-8746-6471a27fba36', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deed5fc2-4a78-4c44-b45e-0c2151d0d123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deed5fc2-4a78-4c44-b45e-0c2151d0d123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b725a972-de40-4fc9-8ed6-584db25b13d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:23 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume b89e4184-6411-422d-8746-6471a27fba36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b89e4184-6411-422d-8746-6471a27fba36', 'volume_size': 1}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:23 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-07afd170-cfa1-4d31-92e1-e0df5966444b tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created volume successfully.
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-135a1e47-d295-4958-a30e-6ee26c7e394f" returned: 0 in 0.556s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] <== create_volume: return (1481ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441875962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560b626a-7346-4db8-8350-357da8bc659f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:20Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Creating volume 560b626a-7346-4db8-8350-357da8bc659f {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:23 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-560b626a-7346-4db8-8350-357da8bc659f 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:23 devstack quobyte-client[83236]: System call of process 101629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:55:23 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=163, name=volume-560b626a-7346-4db8-8350-357da8bc659f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c51963e-8463-4d7b-9026-c168e7789b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135a1e47-d295-4958-a30e-6ee26c7e394f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7428343c-0368-4ce2-99d4-17a61e636a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-560b626a-7346-4db8-8350-357da8bc659f 1073741824" returned: 0 in 0.460s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-560b626a-7346-4db8-8350-357da8bc659f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:23 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume volume-135a1e47-d295-4958-a30e-6ee26c7e394f (135a1e47-d295-4958-a30e-6ee26c7e394f): created successfully
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7428343c-0368-4ce2-99d4-17a61e636a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:23 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (a70d3e76-bdd8-444a-91f3-7021e852f25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-560b626a-7346-4db8-8350-357da8bc659f" returned: 0 in 0.410s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] <== create_volume: return (895ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.858s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611092768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97a1612-0768-4dfe-9e5f-a477504a9616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:20Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Creating volume b97a1612-0768-4dfe-9e5f-a477504a9616 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:24 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b97a1612-0768-4dfe-9e5f-a477504a9616 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:24 devstack quobyte-client[83236]: System call of process 101633 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:55:24 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=164, name=volume-b97a1612-0768-4dfe-9e5f-a477504a9616, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:24 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-70afccc0-783a-450b-8a90-ad95f79447c4 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created volume successfully.
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec7fc78-5f93-4a41-909d-ff6b3ff2e8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560b626a-7346-4db8-8350-357da8bc659f', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e01bdea-f802-46f5-95b7-a97babb5d147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:24 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume volume-560b626a-7346-4db8-8350-357da8bc659f (560b626a-7346-4db8-8350-357da8bc659f): created successfully
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e01bdea-f802-46f5-95b7-a97babb5d147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (4eedc015-96e5-49f3-a0c1-d084ae43b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b97a1612-0768-4dfe-9e5f-a477504a9616 1073741824" returned: 0 in 0.601s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b97a1612-0768-4dfe-9e5f-a477504a9616 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b97a1612-0768-4dfe-9e5f-a477504a9616" returned: 0 in 0.161s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:24 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b5dfdcd8-2170-473e-991e-e313c387dfbb tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created volume successfully.
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] <== create_volume: return (899ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:55:24 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377323467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89e4184-6411-422d-8746-6471a27fba36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9394a8bee45c1b12f00ed9a73e4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:21Z,use_quota=True,user_id='e6115cc0b26a470d936bf5fd4ae8b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Creating volume b89e4184-6411-422d-8746-6471a27fba36 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:25 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b89e4184-6411-422d-8746-6471a27fba36 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:25 devstack quobyte-client[83236]: System call of process 101637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:55:25 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=165, name=volume-b89e4184-6411-422d-8746-6471a27fba36, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673fa075-20c6-4e66-8da0-2560146f5777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97a1612-0768-4dfe-9e5f-a477504a9616', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ac303a-88f4-4d80-a655-682c9af579fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b89e4184-6411-422d-8746-6471a27fba36 1073741824" returned: 0 in 0.518s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b89e4184-6411-422d-8746-6471a27fba36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:25 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume volume-b97a1612-0768-4dfe-9e5f-a477504a9616 (b97a1612-0768-4dfe-9e5f-a477504a9616): created successfully
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ac303a-88f4-4d80-a655-682c9af579fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (24be47f9-ecdf-4bc9-ac62-e8788c465a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b89e4184-6411-422d-8746-6471a27fba36" returned: 0 in 0.392s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] <== create_volume: return (941ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:55:25 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-dc23386a-64cc-4278-9d47-72464d84bdc6 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created volume successfully.
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b725a972-de40-4fc9-8ed6-584db25b13d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89e4184-6411-422d-8746-6471a27fba36', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f4fda9-a6d6-461b-b81a-e888dded8bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:26 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume volume-b89e4184-6411-422d-8746-6471a27fba36 (b89e4184-6411-422d-8746-6471a27fba36): created successfully
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f4fda9-a6d6-461b-b81a-e888dded8bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Flow 'volume_create_manager' (1924e663-2f3a-491c-8b38-fdaac0dc9aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:26 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a57bbeaa-9b42-43c6-9809-2a39aedbf6a7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created volume successfully.
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-b89e4184-6411-422d-8746-6471a27fba36-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-b89e4184-6411-422d-8746-6471a27fba36-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:26 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-quobyte-b89e4184-6411-422d-8746-6471a27fba36" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-b89e4184-6411-422d-8746-6471a27fba36" acquired by "delete_volume" :: waited 0.011s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90d1b40-1dcb-4e3d-83e7-938626830931]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:26 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b89e4184-6411-422d-8746-6471a27fba36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:27 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Flow 'volume_create_manager' (13a8ebb0-22c0-4601-9114-20b7fa49061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8950a061-281e-4bd8-900d-e53b561c83be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8950a061-281e-4bd8-900d-e53b561c83be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1404840638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a311fd0c-86c8-4232-a9f3-c3eed5222350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c2c1c494724c63bcbd2f6635f5bb41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:27Z,use_quota=True,user_id='7cd28cadcaeb407aba7a11fc0d8d5abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacfd839-bd84-4ac7-89bf-74057b47d17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacfd839-bd84-4ac7-89bf-74057b47d17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42011ef2-1fd6-432d-a49c-3fc42a9d07ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42011ef2-1fd6-432d-a49c-3fc42a9d07ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a311fd0c-86c8-4232-a9f3-c3eed5222350', 'volume_name': 'volume-a311fd0c-86c8-4232-a9f3-c3eed5222350', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc7d681-e7ad-43d7-94a4-4739e7e8e4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc7d681-e7ad-43d7-94a4-4739e7e8e4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e565277d-cf8f-43e5-a28f-235895d50dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:27 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Volume a311fd0c-86c8-4232-a9f3-c3eed5222350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a311fd0c-86c8-4232-a9f3-c3eed5222350', 'volume_size': 1}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1404840638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a311fd0c-86c8-4232-a9f3-c3eed5222350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c2c1c494724c63bcbd2f6635f5bb41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:27Z,use_quota=True,user_id='7cd28cadcaeb407aba7a11fc0d8d5abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Creating volume a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:27 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b89e4184-6411-422d-8746-6471a27fba36" returned: 0 in 0.707s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b89e4184-6411-422d-8746-6471a27fba36 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:27 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=166, name=volume-a311fd0c-86c8-4232-a9f3-c3eed5222350, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:27 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b89e4184-6411-422d-8746-6471a27fba36" returned: 0 in 0.174s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-b89e4184-6411-422d-8746-6471a27fba36" released by "delete_volume" :: held 1.086s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 1073741824" returned: 0 in 0.518s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350" returned: 0 in 0.271s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] <== create_volume: return (841ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e565277d-cf8f-43e5-a28f-235895d50dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a311fd0c-86c8-4232-a9f3-c3eed5222350', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f09eaa-54eb-41aa-9e71-4960dc133b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created reservations ['46a595b2-60f9-4522-ac52-ecdcb8785be7', '4b20940e-0428-4819-b9f3-adcc93af7fb9', '13e00f1e-bba4-4655-99be-b29d4b8a78e8', '8d9ccceb-1827-476d-865b-c037633a07bc'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:28 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Volume volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 (a311fd0c-86c8-4232-a9f3-c3eed5222350): created successfully
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f09eaa-54eb-41aa-9e71-4960dc133b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Flow 'volume_create_manager' (13a8ebb0-22c0-4601-9114-20b7fa49061b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:28 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-bcbc1872-09ba-45bb-a828-13e41d6ec450 tempest-SnapshotDependencyTests-898360013 None] Created volume successfully.
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.122s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:28 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:29 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Deleted volume successfully.
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-560b626a-7346-4db8-8350-357da8bc659f-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-560b626a-7346-4db8-8350-357da8bc659f-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-de2f0c3e-36ec-4f30-a477-4bba359c6169 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-b89e4184-6411-422d-8746-6471a27fba36-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:29 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-quobyte-560b626a-7346-4db8-8350-357da8bc659f" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-560b626a-7346-4db8-8350-357da8bc659f" acquired by "delete_volume" :: waited 0.016s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdbcaf2-2afa-4d70-a771-94bbf59bbb08]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-560b626a-7346-4db8-8350-357da8bc659f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:29 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:29 devstack quobyte-client[83236]: System call of process 101651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Creating offline snapshot 0b88152c-4104-4a68-8142-dc29279c8c8e of volume a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:55:29 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-560b626a-7346-4db8-8350-357da8bc659f" returned: 0 in 0.551s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-560b626a-7346-4db8-8350-357da8bc659f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dea4e0-a34e-4f9c-99f0-da5e137285d5]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-560b626a-7346-4db8-8350-357da8bc659f" returned: 0 in 0.203s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-560b626a-7346-4db8-8350-357da8bc659f" released by "delete_volume" :: held 0.950s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created reservations ['c4ba39ba-e424-48e3-a4e9-852267b6ebfe', '5e39a5a9-eb7e-426a-b528-ae12604cd505', '5e8a743f-2d16-417d-b595-57a692df104e', '5289fb3c-6cea-46b9-a2eb-508bab732010'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350" returned: 0 in 0.587s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:30 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=167, name=volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e 1G" returned: 0 in 0.239s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:30 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] CMD "qemu-img rebase -u -b volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e" returned: 0 in 0.337s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:55:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:31 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-b97a1612-0768-4dfe-9e5f-a477504a9616-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e" returned: 0 in 0.417s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:31 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:55:31 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-b97a1612-0768-4dfe-9e5f-a477504a9616-delete_volume" acquired by "delete_volume" :: waited 0.339s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e" returned: 0 in 0.524s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.556s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.info" returned: 0 in 0.374s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:55:32 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Deleted volume successfully.
Sep 17 15:55:33 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-quobyte-b97a1612-0768-4dfe-9e5f-a477504a9616" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.info" returned: 0 in 0.389s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.298s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-b97a1612-0768-4dfe-9e5f-a477504a9616" acquired by "delete_volume" :: waited 0.140s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:33 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a84b1ed9-6323-4da9-afae-9c938005aad7 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-560b626a-7346-4db8-8350-357da8bc659f-delete_volume" released by "delete_volume" :: held 4.002s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:33 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf502c39-04f0-4400-aa13-8c7678b5a647]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b97a1612-0768-4dfe-9e5f-a477504a9616 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:33 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a6832a7c-105f-4a1d-a770-ab65aa0257b8 tempest-SnapshotDependencyTests-898360013 None] Create snapshot completed successfully
Sep 17 15:55:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b97a1612-0768-4dfe-9e5f-a477504a9616" returned: 0 in 0.537s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:33 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b97a1612-0768-4dfe-9e5f-a477504a9616 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-b97a1612-0768-4dfe-9e5f-a477504a9616" returned: 0 in 0.162s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-b97a1612-0768-4dfe-9e5f-a477504a9616" released by "delete_volume" :: held 0.812s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created reservations ['26671bed-74b0-4181-8977-e9b29542e01d', '3abc4554-40b9-4f86-9ed9-3fa1315f01a5', '2790653e-72e0-4253-ad7b-9fe34824b9e0', 'd9698ba1-cd3a-4785-a55a-56a5281eca3f'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:34 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Flow 'volume_create_manager' (f0048292-7796-4f22-ab4e-99ef607995a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe6f238-1a8a-44e0-8f93-cbbcf9b772e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:34 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-135a1e47-d295-4958-a30e-6ee26c7e394f-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe6f238-1a8a-44e0-8f93-cbbcf9b772e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9b8a20-e5c9-4810-9cf4-bb8e0288248d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c2c1c494724c63bcbd2f6635f5bb41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b88152c-4104-4a68-8142-dc29279c8c8e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:34Z,use_quota=True,user_id='7cd28cadcaeb407aba7a11fc0d8d5abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6346df74-99a6-49d2-9de3-2bd759a10bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6346df74-99a6-49d2-9de3-2bd759a10bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a65133-9b60-4cee-a26d-b3035f573dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a65133-9b60-4cee-a26d-b3035f573dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed9b8a20-e5c9-4810-9cf4-bb8e0288248d', 'volume_name': 'volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d', 'volume_size': 1, 'snapshot_id': '0b88152c-4104-4a68-8142-dc29279c8c8e'}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef6125-ecfc-4ddd-b474-e0365d352478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef6125-ecfc-4ddd-b474-e0365d352478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cbbeb3-5ade-41d2-8354-05421e3c0a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:35 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Volume ed9b8a20-e5c9-4810-9cf4-bb8e0288248d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d', 'volume_size': 1, 'snapshot_id': '0b88152c-4104-4a68-8142-dc29279c8c8e'}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.520s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "cinder-quobyte-0b88152c-4104-4a68-8142-dc29279c8c8e-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" by "_create_volume_from_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:35 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Deleted volume successfully.
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-135a1e47-d295-4958-a30e-6ee26c7e394f-delete_volume" acquired by "delete_volume" :: waited 0.255s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-0b88152c-4104-4a68-8142-dc29279c8c8e-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" acquired by "_create_volume_from_snapshot" :: waited 0.081s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Creating volume ed9b8a20-e5c9-4810-9cf4-bb8e0288248d from snapshot 0b88152c-4104-4a68-8142-dc29279c8c8e {{(pid=83214) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "cinder-quobyte-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" by "_copy_volume_from_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-a5368694-c393-4bb1-897b-4729bd8ecc4d tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-b97a1612-0768-4dfe-9e5f-a477504a9616-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] snapshot: 0b88152c-4104-4a68-8142-dc29279c8c8e, volume: ed9b8a20-e5c9-4810-9cf4-bb8e0288248d,  {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 15:55:35 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-quobyte-135a1e47-d295-4958-a30e-6ee26c7e394f" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-135a1e47-d295-4958-a30e-6ee26c7e394f" acquired by "delete_volume" :: waited 0.043s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bcce8b-1ca2-44a2-92d7-696d5213bc73]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae797069-7036-4c74-bc96-a19b325e3f30]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-135a1e47-d295-4958-a30e-6ee26c7e394f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e" returned: 0 in 0.457s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a311fd0c-86c8-4232-a9f3-c3eed5222350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Creating direct copy from snapshot {{(pid=83214) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[57091605-4f83-428e-9266-07244406d386]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:35 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-135a1e47-d295-4958-a30e-6ee26c7e394f" returned: 0 in 0.586s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-135a1e47-d295-4958-a30e-6ee26c7e394f {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-135a1e47-d295-4958-a30e-6ee26c7e394f" returned: 0 in 0.117s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:36 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-135a1e47-d295-4958-a30e-6ee26c7e394f" released by "delete_volume" :: held 0.944s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350" returned: 0 in 0.591s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:36 devstack cinder-volume[83214]: DEBUG cinder.utils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d not found in is_blk_device check {{(pid=83214) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 15:55:36 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:36 devstack quobyte-client[83236]: System call of process 101685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:55:36 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=169, name=volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:37 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created reservations ['0a0579a3-454b-4ccd-9082-a84e33ed40b6', '5a4f6e78-df61-47c3-95ec-14e08d941bc6', 'c3b31e9f-4e0b-4457-be59-c3b05df7509d', '25bbbe60-8944-436f-b01f-a0b4b885d758'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:38 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:38 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.320s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:38 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:38 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Deleted volume successfully.
Sep 17 15:55:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-36d03bed-898d-4c87-9cd6-63169edf09b5 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-135a1e47-d295-4958-a30e-6ee26c7e394f-delete_volume" released by "delete_volume" :: held 4.449s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:39 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2-delete_volume" acquired by "delete_volume" :: waited 0.268s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:40 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-quobyte-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:40 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2" acquired by "delete_volume" :: waited 0.028s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:40 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b207b276-41a2-40b0-a3cb-3d8efbb190c8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:40 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:41 devstack quobyte-client[83236]: System call of process 101728 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:55:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2" returned: 0 in 0.992s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:41 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2" returned: 0 in 0.498s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:42 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2" released by "delete_volume" :: held 2.060s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" returned: 0 in 6.037s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:42 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c21089-edf6-4e7e-9f97-434171936c01]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:42 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:42 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created reservations ['b62a0f36-b018-4b69-b784-b95981599bbb', 'd855fdee-c85f-498f-a9a7-db1767230c94', '606659c8-be99-4b21-a2ba-38f09603f881', 'a7e404c3-f2b8-4631-8813-255870648888'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.092s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:43 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Deleted volume successfully.
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350" returned: 0 in 0.886s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG cinder.image.image_utils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Image conversion details: src /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d {{(pid=83214) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 15:55:43 devstack cinder-volume[83214]: INFO cinder.image.image_utils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Converted 1024.00 MB image at 169.50 MB/s
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-64ed6653-30f2-41f0-91e5-515937575d58 tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-bdb709d9-fdd9-4f7b-8a21-d4bd68db4bf2-delete_volume" released by "delete_volume" :: held 3.958s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" returned: 0 in 0.217s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" released by "_copy_volume_from_snapshot" :: held 8.425s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-0b88152c-4104-4a68-8142-dc29279c8c8e-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" released by "_create_volume_from_snapshot" :: held 8.478s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.564s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:43 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cbbeb3-5ade-41d2-8354-05421e3c0a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d', 'volume_size': 1, 'snapshot_id': '0b88152c-4104-4a68-8142-dc29279c8c8e'}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef8a2b4-6ad1-492e-8413-da3fb2ef8a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:44 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Volume volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d (ed9b8a20-e5c9-4810-9cf4-bb8e0288248d): created successfully
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef8a2b4-6ad1-492e-8413-da3fb2ef8a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Flow 'volume_create_manager' (f0048292-7796-4f22-ab4e-99ef607995a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:44 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-7a7cbf87-28ce-43c1-81b1-9187f270097c tempest-SnapshotDependencyTests-898360013 None] Created volume successfully.
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:44 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "cinder-quobyte-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1" acquired by "delete_volume" :: waited 0.013s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[65708332-4eff-4334-918a-94191e361bbe]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1" returned: 0 in 0.392s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:44 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1" returned: 0 in 0.116s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-quobyte-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1" released by "delete_volume" :: held 0.670s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "cinder-0b88152c-4104-4a68-8142-dc29279c8c8e-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-0b88152c-4104-4a68-8142-dc29279c8c8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:45 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "cinder-quobyte-a311fd0c-86c8-4232-a9f3-c3eed5222350" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-a311fd0c-86c8-4232-a9f3-c3eed5222350" acquired by "delete_snapshot" :: waited 0.076s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "cinder-quobyte-0b88152c-4104-4a68-8142-dc29279c8c8e" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Created reservations ['c7e26744-6722-4a3b-98f2-6685cf53000e', '06146598-3aad-47b8-82a9-4bbcd93a9e1b', '2044fc49-2511-4491-85f0-452787996af9', '335a200d-b621-42ec-a91a-d394d475593d'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-0b88152c-4104-4a68-8142-dc29279c8c8e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Deleting offline snapshot 0b88152c-4104-4a68-8142-dc29279c8c8e of volume a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] snapshot_file for this snap is: volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b724514b-b353-49d0-9ed5-175b0a04448b]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:45 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e" returned: 0 in 0.594s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:46 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a311fd0c-86c8-4232-a9f3-c3eed5222350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:55:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.177s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:46 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:46 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Deleted volume successfully.
Sep 17 15:55:46 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[e262a6e3-e80f-4e22-812c-aa4cfe2261a5]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:46 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-694ae9d6-367a-4500-a24b-de9321a5c5ed tempest-CreateVolumesFromSourceVolumeTest-521667593 None] Lock "cinder-e4ff3743-7d2f-43ae-93ee-b788ce79d7c1-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350" returned: 0 in 0.524s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:46 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:47 devstack quobyte-client[83236]: System call of process 101749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:55:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e" returned: 0 in 0.227s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:47 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350.0b88152c-4104-4a68-8142-dc29279c8c8e" returned: 0 in 0.138s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-0b88152c-4104-4a68-8142-dc29279c8c8e" released by "_delete_snapshot" :: held 1.961s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-a311fd0c-86c8-4232-a9f3-c3eed5222350" released by "delete_snapshot" :: held 2.005s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:47 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Created reservations ['678dd711-381b-4246-94af-b1b257475030', 'd7611234-cbfd-4bd4-bdf0-1f7771281c6e', 'ccf4fcfc-f3a5-4c7b-a4bb-15bd7065d6c1', 'cd6bbbaa-f50e-42ca-b6e2-e01e7563888d'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:47 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Delete snapshot completed successfully.
Sep 17 15:55:47 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9f3944bd-a258-4af6-9af9-1882bdda5712 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-0b88152c-4104-4a68-8142-dc29279c8c8e-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "cinder-a311fd0c-86c8-4232-a9f3-c3eed5222350-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-a311fd0c-86c8-4232-a9f3-c3eed5222350-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:48 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "cinder-quobyte-a311fd0c-86c8-4232-a9f3-c3eed5222350" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:48 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-a311fd0c-86c8-4232-a9f3-c3eed5222350" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:48 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[131743fb-b335-4d68-8d69-3c444af52cd9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:48 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350" returned: 0 in 0.490s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-a311fd0c-86c8-4232-a9f3-c3eed5222350" returned: 0 in 0.123s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-a311fd0c-86c8-4232-a9f3-c3eed5222350" released by "delete_volume" :: held 0.781s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Created reservations ['d7614258-de1d-40c3-b6f5-aca10934e12a', 'cac9f07b-8cd6-46e5-a12f-47dd6beb5eb6', '6c404cb4-b67e-465d-a8e7-ec9d10610b86', '94546249-cd39-4ee6-80ce-43f4e6156ed4'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:49 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Flow 'volume_create_manager' (e4790aae-f83b-4f00-8880-0b5da9e16f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95954a3-17aa-4c2c-8cc6-8718bfc9e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95954a3-17aa-4c2c-8cc6-8718bfc9e601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea26a4d7-829f-476e-820c-3d971d0bb8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf0dcacd44b4bd5a9b9f26bd1c49fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:50Z,use_quota=True,user_id='80505bd49eec4909885f7979e3845271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857b181-7150-430c-863f-515c4250fa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857b181-7150-430c-863f-515c4250fa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69a0329-3f51-461c-b0dd-4655661e2ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69a0329-3f51-461c-b0dd-4655661e2ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea26a4d7-829f-476e-820c-3d971d0bb8ed', 'volume_name': 'volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4688e551-f231-40c6-870b-a374c9e469cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4688e551-f231-40c6-870b-a374c9e469cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b07f26-9ce4-4ec1-9fe7-cb4f92c42874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:49 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Volume ea26a4d7-829f-476e-820c-3d971d0bb8ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed', 'volume_size': 1}
Sep 17 15:55:49 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea26a4d7-829f-476e-820c-3d971d0bb8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf0dcacd44b4bd5a9b9f26bd1c49fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:50Z,use_quota=True,user_id='80505bd49eec4909885f7979e3845271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Creating volume ea26a4d7-829f-476e-820c-3d971d0bb8ed {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:50 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:50 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=170, name=volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed 1073741824" returned: 0 in 0.383s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed" returned: 0 in 0.196s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] <== create_volume: return (629ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.641s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:50 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "cinder-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b07f26-9ce4-4ec1-9fe7-cb4f92c42874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f22a513-2360-4bb3-a458-ee5fd65d2046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.470s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d-delete_volume" acquired by "delete_volume" :: waited 0.259s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Deleted volume successfully.
Sep 17 15:55:51 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Volume volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed (ea26a4d7-829f-476e-820c-3d971d0bb8ed): created successfully
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f22a513-2360-4bb3-a458-ee5fd65d2046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Flow 'volume_create_manager' (e4790aae-f83b-4f00-8880-0b5da9e16f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-ef2572c2-e187-44c9-bc8b-463e31d55848 tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-a311fd0c-86c8-4232-a9f3-c3eed5222350-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:51 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-643cd18b-fe5e-4f0c-bcd8-76501ba45fe2 tempest-CinderUnicodeTest-1150492365 None] Created volume successfully.
Sep 17 15:55:51 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "cinder-quobyte-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" acquired by "delete_volume" :: waited 0.014s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1872f99-b60b-4f60-b923-6fc7104f10b9]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" returned: 0 in 0.421s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:51 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" returned: 0 in 0.165s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-quobyte-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d" released by "delete_volume" :: held 0.785s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:52 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.flows.manager.create_volume [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83214) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Flow 'volume_create_manager' (8b629103-1f65-41fa-8d8a-cca67d6a7372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878460a9-f1d0-40eb-aa59-3bd74f69f1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878460a9-f1d0-40eb-aa59-3bd74f69f1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1599906526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f0a385-387e-4077-9fe1-e0299b09233d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf0dcacd44b4bd5a9b9f26bd1c49fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:52Z,use_quota=True,user_id='80505bd49eec4909885f7979e3845271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97662de1-e04c-41cf-a33f-17bee0b7d8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97662de1-e04c-41cf-a33f-17bee0b7d8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d305e0-98f8-4a58-9851-7f2a52406193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d305e0-98f8-4a58-9851-7f2a52406193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f0a385-387e-4077-9fe1-e0299b09233d', 'volume_name': 'volume-f7f0a385-387e-4077-9fe1-e0299b09233d', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df180c58-b20c-4805-8976-7343ebfd2c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df180c58-b20c-4805-8976-7343ebfd2c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02a681d-7cef-41cf-922f-a2cbc64f56bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:52 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Volume f7f0a385-387e-4077-9fe1-e0299b09233d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f0a385-387e-4077-9fe1-e0299b09233d', 'volume_size': 1}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd4b40bbdf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T13:55:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1599906526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f0a385-387e-4077-9fe1-e0299b09233d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf0dcacd44b4bd5a9b9f26bd1c49fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T13:55:52Z,use_quota=True,user_id='80505bd49eec4909885f7979e3845271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(771113d7-67d6-405a-b7e4-19d27ba13de5),volume_type_id=771113d7-67d6-405a-b7e4-19d27ba13de5)}" {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Creating volume f7f0a385-387e-4077-9fe1-e0299b09233d {{(pid=83214) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Selected 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11 as target Quobyte volume. {{(pid=83214) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 15:55:52 devstack cinder-volume[83214]: INFO cinder.volume.drivers.remotefs [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] casted to 10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d 1073741824 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:52 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=171, name=volume-f7f0a385-387e-4077-9fe1-e0299b09233d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:52 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Created reservations ['1f57e97f-5351-416f-9c27-684f316495aa', '163977cb-e7bd-4e88-8a77-53f3b467aaec', '2fd96bf7-65bb-4e2b-b857-99ba0b595a1a', 'a2025e4f-cb0c-4fd1-aa88-c583931699b8'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d 1073741824" returned: 0 in 0.441s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d" returned: 0 in 0.269s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] <== create_volume: return (750ms) {'provider_location': '10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'} {{(pid=83214) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02a681d-7cef-41cf-922f-a2cbc64f56bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f0a385-387e-4077-9fe1-e0299b09233d', 'volume_size': 1}' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7603671d-8392-45bd-b808-57820612c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:53 devstack cinder-volume[83214]: INFO cinder.volume.flows.manager.create_volume [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Volume volume-f7f0a385-387e-4077-9fe1-e0299b09233d (f7f0a385-387e-4077-9fe1-e0299b09233d): created successfully
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7603671d-8392-45bd-b808-57820612c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83214) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 15:55:53 devstack cinder-volume[83214]: DEBUG cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Flow 'volume_create_manager' (8b629103-1f65-41fa-8d8a-cca67d6a7372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83214) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 15:55:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.314s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:54 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:55:54 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Deleted volume successfully.
Sep 17 15:55:54 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e460abb9-ae78-44ef-b9fb-9b51c88ce39d tempest-CinderUnicodeTest-1150492365 None] Created volume successfully.
Sep 17 15:55:54 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-57bcff5d-1633-47e1-a811-42795362d48e tempest-SnapshotDependencyTests-898360013 None] Lock "cinder-ed9b8a20-e5c9-4810-9cf4-bb8e0288248d-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:55:54 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:55:54 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:55:54 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Creating offline snapshot 0893ccf1-3e02-48cf-937c-736126862136 of volume f7f0a385-387e-4077-9fe1-e0299b09233d {{(pid=83214) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 15:55:55 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f87918e-48aa-498b-ab60-a37eaf72cedf]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d" returned: 0 in 0.644s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:55 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 1G {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:55 devstack quobyte-client[83236]: The server volume:c7001698-d85a-4237-9fdf-98dab0229404@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c7001698-d85a-4237-9fdf-98dab0229404, inode=172, name=volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.203), requestorAccessMask=0
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 1G" returned: 0 in 0.355s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f7f0a385-387e-4077-9fe1-e0299b09233d -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] CMD "qemu-img rebase -u -b volume-f7f0a385-387e-4077-9fe1-e0299b09233d -F qcow2 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136" returned: 0 in 0.153s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136" returned: 0 in 0.103s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Setting permissions: /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d -> 1000:1000 {{(pid=83214) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136" returned: 0 in 0.098s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.info" returned: 0 in 0.101s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] File path /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.info is being set with permissions: 660 {{(pid=83214) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.info {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.info" returned: 0 in 0.109s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:56 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:55:57 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-27998955-17c4-40c0-b192-c1b844b7315c tempest-CinderUnicodeTest-1150492365 None] Create snapshot completed successfully
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "cinder-0893ccf1-3e02-48cf-937c-736126862136-delete_snapshot" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-0893ccf1-3e02-48cf-937c-736126862136-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:58 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "cinder-quobyte-f7f0a385-387e-4077-9fe1-e0299b09233d" by "delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-quobyte-f7f0a385-387e-4077-9fe1-e0299b09233d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "cinder-quobyte-0893ccf1-3e02-48cf-937c-736126862136" by "_delete_snapshot" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-quobyte-0893ccf1-3e02-48cf-937c-736126862136" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Deleting offline snapshot 0893ccf1-3e02-48cf-937c-736126862136 of volume f7f0a385-387e-4077-9fe1-e0299b09233d {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] snapshot_file for this snap is: volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 {{(pid=83214) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[8445eb5b-8c38-4621-8171-4c7a977f6db2]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136" returned: 0 in 0.521s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:58 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.remotefs [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7f0a385-387e-4077-9fe1-e0299b09233d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83214) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 15:55:59 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed43b8ae-6de1-4400-a616-b5f15e2314c8]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:55:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d" returned: 0 in 0.605s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:55:59 devstack quobyte-client[83236]: System call of process 101793 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 15:55:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136" returned: 0 in 0.246s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:55:59 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136 {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:56:00 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d.0893ccf1-3e02-48cf-937c-736126862136" returned: 0 in 0.117s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:56:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-quobyte-0893ccf1-3e02-48cf-937c-736126862136" released by "_delete_snapshot" :: held 1.888s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:56:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-quobyte-f7f0a385-387e-4077-9fe1-e0299b09233d" released by "delete_snapshot" :: held 1.952s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:56:00 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Created reservations ['33bad9ab-5a7c-4624-98cc-be95f3ab688a', '59852528-fd01-45bd-972b-e02566c5cbdc', 'c95dfe6b-d932-4627-bf6d-0a0a216fba0f', 'a2627d07-2a43-4031-b578-2c98abe2f010'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:56:00 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Delete snapshot completed successfully.
Sep 17 15:56:00 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-b0f8f274-7dab-4367-bc66-fe5fbe2394ba tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-0893ccf1-3e02-48cf-937c-736126862136-delete_snapshot" released by "delete_snapshot" :: held 2.548s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:56:01 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "cinder-f7f0a385-387e-4077-9fe1-e0299b09233d-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:56:01 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-f7f0a385-387e-4077-9fe1-e0299b09233d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:56:01 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:56:01 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "cinder-quobyte-f7f0a385-387e-4077-9fe1-e0299b09233d" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:56:01 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-quobyte-f7f0a385-387e-4077-9fe1-e0299b09233d" acquired by "delete_volume" :: waited 0.018s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:56:01 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8641a4c-8efd-4a65-9faa-32e1f1642a69]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:56:01 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d" returned: 0 in 0.439s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-f7f0a385-387e-4077-9fe1-e0299b09233d" returned: 0 in 0.106s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-quobyte-f7f0a385-387e-4077-9fe1-e0299b09233d" released by "delete_volume" :: held 0.731s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Created reservations ['b31d84f8-df27-4e43-971f-d04b7a7dc00b', '163d3109-2740-4b98-92d8-02a7f65767a5', '2573b98a-6a96-4922-870f-0ee362128ea7', '28ce0e71-7334-473c-b70b-c9ac8be6de30'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:56:02 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:56:03 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.096s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:56:03 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:56:03 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Deleted volume successfully.
Sep 17 15:56:03 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-e57bae72-8151-417c-bb32-a01efbb30cd9 tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-f7f0a385-387e-4077-9fe1-e0299b09233d-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:56:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "cinder-ea26a4d7-829f-476e-820c-3d971d0bb8ed-delete_volume" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:56:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-ea26a4d7-829f-476e-820c-3d971d0bb8ed-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:56:04 devstack cinder-volume[83214]: WARNING cinder.volume.volume_utils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 15:56:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "cinder-quobyte-ea26a4d7-829f-476e-820c-3d971d0bb8ed" by "delete_volume" {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 15:56:04 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-quobyte-ea26a4d7-829f-476e-820c-3d971d0bb8ed" acquired by "delete_volume" :: waited 0.017s {{(pid=83214) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 15:56:04 devstack cinder-volume[83214]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd42f12-a4f1-4cc2-84a2-0e753fe04766]: (4, 'qcow2') {{(pid=83527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 15:56:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:56:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed" returned: 0 in 0.464s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:56:04 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] CMD "rm -f /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e/volume-ea26a4d7-829f-476e-820c-3d971d0bb8ed" returned: 0 in 0.137s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-quobyte-ea26a4d7-829f-476e-820c-3d971d0bb8ed" released by "delete_volume" :: held 0.776s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG cinder.quota [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Created reservations ['a08b050d-0780-4bc9-82b5-515868a192b5', '4e8a030c-dbe2-40b1-b621-e5f1f419a873', '2945ceb3-0097-46a3-9258-d6c911704d79', '2fbccefb-1b8d-44c4-9b98-3b0fdc8ef3b6'] {{(pid=83214) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.094s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:56:05 devstack cinder-volume[83214]: INFO cinder.volume.manager [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Deleted volume successfully.
Sep 17 15:56:05 devstack cinder-volume[83214]: DEBUG cinder.coordination [None req-9d0f3a8e-b86b-4dde-8551-79a893ef4b1d tempest-CinderUnicodeTest-1150492365 None] Lock "cinder-ea26a4d7-829f-476e-820c-3d971d0bb8ed-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=83214) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 15:56:12 devstack cinder-volume[83214]: DEBUG oslo_service.periodic_task [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83214) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 15:56:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 15:56:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 15:56:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11': None} {{(pid=83214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 15:56:12 devstack cinder-volume[83214]: DEBUG cinder.volume.drivers.quobyte [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Available shares ['10.10.41.181/cinder-vol-99674a73-2dc3-4f5c-b999-4ab2be703a11'] {{(pid=83214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 15:56:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.lockutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83214) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 15:56:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 15:56:12 devstack cinder-volume[83214]: DEBUG oslo_concurrency.processutils [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/cfba81a54e356c9d3708790cf4ba261e" returned: 0 in 0.114s {{(pid=83214) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 15:56:12 devstack cinder-volume[83214]: DEBUG cinder.manager [None req-b050f863-2509-4854-bec6-4e2e0f96cd60 None None] Notifying Schedulers of capabilities ... {{(pid=83214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 15:56:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=135,cinder:SELECT=67,cinder:DELETE=8,cinder:INSERT=28 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 15:56:17 devstack cinder-volume[83214]: DEBUG dbcounter [-] [83214] Writing DB stats cinder:UPDATE=88,cinder:SELECT=78,cinder:DELETE=13,cinder:INSERT=20 {{(pid=83214) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}